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Witold Kosiński (1946-2014) 


Foreword 


I met Witek Kosiński 20 years ago (almost to the day), as at that time he was 
appointed by the Institute of Computer Science, Polish Academy of Sciences, as a 
reviewer for my DSc (habilitation) thesis. His review was quite positive (!) and 
from that time we developed a long-lasting friendship. Later, both of us were 
associated with the Polish-Japanese Academy of Information Technology and 
together we supervised a few students, introduced new courses (e.g., puzzle-based 
learning), worked on several research grants, and wrote a few research papers. He, 
with his wife Ewa, visited us in the United States and stayed with us in our home; 
they also planned to visit us in Australia. Unfortunately, time had run out for him. 

It is my privilege to write the foreword for this book. First, I consider Witek one 
of the best friends I had in life. Second, his warm personality, sense of humor, and 
amazing intelligence made him a very special person in the lives and careers of so 
many people. Finally, the book covers many topics that were close to Witek’s heart 
—fuzzy sets, fuzzy systems, Ordered Fuzzy Numbers—to name a few. He also had 
a keen interest in applications of his research, and thus the third part of the book 
contains 11 application-oriented chapters. 

Witek—you’ll live in our memories forever. We miss you. 


February 2017 Zbigniew Michalewicz 


Memories of Professor Witold Kosinski 


Józef Kubik, Mariusz Kaczmarek, Marcin Sydow 
and Dominik Slezak 


Professor Witold Kosinski, Polish mathematician and computer scientist, specialist 
in the fields of mathematical theory of continuous media and various methods of 
artificial intelligence with particular focus on fuzzy logic, conducted creative and 
very intense research activities for more than 40 years, combining research with 
broad international cooperation and regular teaching. 


Scientific Development 


Witold Kosiński was born in Kraków on August 13, 1946. He attended the Juliusz 
Slowacki High School in Warsaw in the years 1960-1964. 

In 1969, he graduated from the University of Warsaw, the Faculty of 
Mathematics and Mechanics, obtaining his M.Sc. degree in mathematics for the 
thesis, “On the Existence of Two Variables Satisfying Some Differential 
Inequality.” His supervisor was Prof. Jan Rychlewski, later a member of the Polish 
Academy of Sciences. 

Directly upon graduation he became a member of the Department of Mechanics 
of Continuous Media in the Institute of Fundamental Technological Research of the 
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Kazimierz Wielki University, Bydgoszcz, Poland, e-mail: mkk @ukw.edu.pl 
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Polish-Japanese Academy of Information Technology, Warsaw, Poland, 
e-mail: msyd@poljap.edu.pl 


Dominik Slezak 
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Polish Academy of Sciences, where he continued to develop his scientific quali- 
fications by participation in doctoral studies. 

In 1972, he obtained his Ph.D. degree in technical sciences with his dissertation, 
“Linear Theory of Rheological Materials with Internal Structural Changes.” His 
supervisor was Prof. Piotr Perzyna, a great scientist and author of one of the 
important directions within viscoelasticity theory. Very soon, Dr. Kosinski’s ability 
to combine mathematical methods with a modern approach to mechanics of 
deformable dissipative materials resulted in a number of achievements. In the years 
1972-1974, he coauthored 19 research papers, 10 of which were published in the 
renowned Bulletin of the Polish Academy of Sciences. 

In 1984 his research related to dissipative media led to the summarizing article 
on the equations of dissipative materials’ evolution resulting in the title of Doctor of 
Sciences (habilitation) in mechanical engineering being conferred upon him by the 
Scientific Council of the Institute of Fundamental Technological Research of the 
Polish Academy of Sciences. Finally, in 1993 his extensive research and teaching 
activities became the basis of granting him the title of full professor of technical 
sciences by the President of the Republic of Poland. 


Scientific and Academic Achievements (Part I) 


For most of his professional career Prof. Kosinski was affiliated with the Institute of 
Fundamental Technological Research of the Polish Academy of Sciences (1972- 
2001). In that period, he achieved numerous original results that contributed to 
international research on thermodynamics of materials with memory and materials 
with internal variables. 

Those studies also concerned thermal waves in nonelastic media with so-called 
second sound effect, and were carried out jointly with other coauthors including, 
among others, V.A. Cimmelli, K. Frischmuth, K. Saxton, R. Saxton, W. Wojno, and 
P. Perzyna. Other studies on thermodynamics of porous media saturated with liquid 
were performed with the cooperation of K. Hutter, J. Kubik, M. Cieszko, and M. 
Kaczmarek. The monograph entitled Clear-cut Nature of Initial and Boundary-value 
Solutions in the Theory of High and Low Non-elastic Strain in Scope of Hyperbolic 
Problems (W. Kosinski, Ed., Ossolineum, 1979) aroused much interest. Particular 
recognition was gained by the monograph, Field Singularities and Wave Analysis in 
Continuum Mechanics (W. Kosiński, Ellis Horwood, Mathematics and 
Applications, 1986), which formulated the foundations of the kinematic theory of 
discontinuity surface propagation, the velocity of which depends on a nonlinear 
medium’s properties. The aforementioned range of Prof. Kosinski’s research on 
mechanics of continuous media includes over 100 published scientific papers, two 
monographs, and contributions to nine multiauthored volumes. 
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Scientific and Academic Achievements (Part II) 


In 1999, Prof. Kosinski started his scientific and teaching activities at the 
Polish-Japanese Academy of Information Technology (PJAIT; formerly the 
Polish-Japanese Institute of Information Technology), where he served as a member 
of the Senate and Council of the IT faculty. In 1999-2005, he acted as the PJAIT 
vice-president for research. He was the head of the Multimedia and Artificial 
Intelligence Department, and then the Smart Systems Department and Research 
Center. He was also a coordinator of specializations in Intelligent Data Processing 
Systems, and Business and Administration Support Systems. 

PJAIT-related activities came together with Prof. Kosinski’s growing scientific 
interests in information technology and intelligent systems, with an emphasis on 
neural networks, image processing, fuzzy logic, and nature-inspired optimization 
algorithms. Those interests could be seen even earlier. In the 1990s, he coauthored 
some articles on fuzzy numbers and neuro-fuzzy systems, for example, “Fuzzy 
Numbers and Their Quotient Space with Algebraic Operations” (W. Kosiński, 
P. Slysz, Bulletin of Polish Academy of Sciences: Mathematics, 1993) and “General 
Mapping Approximation Problems Solving by Neural Networks and Fuzzy 
Inference Systems” (W. Kosiński, M. Weigl, Systems Analysis Modelling 
Simulation, 1998). Later on, his interests in fuzzy systems led towards developing a 
new fuzzy arithmetics model described in a number of papers, including “Ordered 
Fuzzy Numbers” (W. Kosinski, P. Prokopowicz, D. Slezak, Bulletin of Polish 
Academy of Sciences: Mathematics, 2003) and “Evolutionary Algorithm 
Determining Defuzzyfication Operators” (W. Kosiński, Engineering Applications 
of AI, 2007), and resulting in a number of applications reported in this book. 

In summary, Prof. Kosinski’s research interests were characterized by true 
interdisciplinarity, openness to new ideas, and the ability to utilize mathematics and 
artificial intelligence to model and solve real-world problems. In particular, in his 
work he combined a strong background in mechanics and materials engineering 
with a good understanding of information technology applications. In our opinion, 
this makes his scientific achievements unique and inspiring to others. 


Scientific Collaboration 


Professor Kosinski developed and maintained broad cooperation with people and 
scientific teams at foreign and domestic universities. He was awarded academic 
scholarships at the University of Iowa (the Division of Materials Engineering), the 
University of Bonn (the Institute of Applied Mathematics), the University of 
Heidelberg (the Institute of Mathematics), and the Darmstadt Technical University 
(the Institute of Mechanics). He was also a scholarship holder of the Alexander von 
Humboldt Foundation (1983-1985 and 1988). 
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Professor Kosiński was a visiting professor in the Laboratory Modeling in 
Mechanics at the University Pierre and Marie Curie in Paris (1989—1990), in the 
Department of Mathematics and Computer Science at Loyola University in New 
Orleans (1991), and in the Faculty of Science and Technology at the University 
Aix-Marseille II (1994-1995). In addition to France, Germany, and the United 
States, he visited universities in several other countries, including Italy and Japan. 
He also collaborated with research groups in Poland, at universities in Warsaw, 
Bialystok, Bydgoszcz, and Toruń, sharing his broad knowledge, international 
experience, and, in particular, his kindness and passion for research. 


Teaching and Supervision 


Seminars and inspiring scientific discussions conducted by Prof. Kosiński resulted 
in a number of joint publications and guided young researchers towards modern 
interdisciplinary topics, those that combined the disciplines of computer science, 
biology, and industry. It is worth noting that he promoted 11 Ph.D. students, as well 
as 148 MSc’s and engineers. 

He liked and valued his teaching activities. He treated students with a true 
respect and in a friendly manner. For almost 20 years, he shared his knowledge with 
students of the Faculty of Mathematics, Physics and Technology at the Kazimierz 
Wielki University in Bydgoszcz (formerly the Academy of Bydgoszcz), with the 
major of “IT Engineering” that he coestablished. For over 15 years, he gave aca- 
demic classes on various IT subjects at PJAIT, where he was one of the key people 
forming the teaching program on AI tools and applications. 

Professor Kosiński also gave advanced lectures as part of graduate and post- 
graduate courses on the analysis of waves, constitutive modeling of nonelastic 
media, and thermodynamics of continua with superficial singularities, as well as on 
selected issues of mathematics, artificial intelligence, and information technology, 
in such units as: the Institute of Fundamental Technological Research of the Polish 
Academy of Sciences, the University of Warsaw, the Stefan Banach’s Center, the 
University of Iowa, and the University of Rome “La Sapienza.” In the 1990s, he 
delivered a truly inspiring graduate course on neural networks at the Faculty of 
Mathematics, Informatics and Mechanics at the University of Warsaw, where he 
was able to put together various aspects of his background and experience to 
provide students with both advanced mathematical foundations and practical 
motivation for mastering the Al-based methodologies. 
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Scientific and Social Services 


An important part of Prof. Kosinski’s activities was his work on editorial boards of 
scientific journals such as Archives of Mechanics, Engineering Transactions, 
Biblioteka Mechaniki Stosowanej (in Polish), Journal of Applied Mathematics and 
Computer Science, and Machine Graphics and Vision. He was also the 
editor-in-chief of the international journal, Mathematica Applicanda, published by 
the Polish Mathematical Society. 

Professor Kosinski was also very active as a member of a number of scientific 
societies including the Polish Society of Theoretical and Applied Mechanics, the 
Polish Mathematical Society, the Association for Image Processing, the Society of 
Interaction of Mathematics and Mechanics, the American Mathematical Society, 
and Societas Humboldtiana Polonorum. 

He was also involved in important scientific projects of a social character. In 
particular, from 2012, he was a member of the Technical Subcommittee for 
Mathematics and Computer Science within the Scientific Committee for indepen- 
dent research on the causes of the Smolensk Catastrophe in 2010. 


Personality and Memoires 


In his everyday professional life, Prof. Kosinski was characterized by exceptional 
elegance, kindliness, openness, an interest in the world, and a sense of humor. He 
led a busy social life and was the so-called “life and soul of the party.” He actively 
practiced sports (e.g., tennis, diving) and was a keen dancer. Below there are several 
opinions of people who knew Witold Kosiński in person. This is how they 
remember him: 


I met Prof. Witold Kosiński a dozen or so years ago. It was my privilege and honor to give 
lab classes to his lectures for 10 years. He liked people and was able to team up with them 
regardless of what they were doing. I used to discuss science with him in a train, in a car, 
restaurant, namely anywhere. Witold used to bring us to places and people he deemed 
worth it. Witold shall always be our spiritus movens, as we believe that, regardless where 
he is now, he still counts on us and counts with us. 


Jacek Czerniak 
Kazimierz Wielki University, Bydgoszcz, Poland 


Witek Kosinski was an exceptional man, researcher, and above all, a friend—his warm 
personality and a sense of humor made him a very special man. We will miss him a lot! 


Zbigniew Michalewicz 
University of Adelaide, Adelaide, Australia 
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Professor Witold Kosinski’s wide-ranging interests reached far beyond math and computer 
science. His scientific intuition unveiled not only basic application of the discussed issue, 
but also possible secondary applications, and directions for further research. He made us 
believe in ourselves and our ability to succeed as students, professionals, and scientists. 


Dariusz Mikołajewski 
Kazimierz Wielki University, Bydgoszcz, Poland 


Any time I met Prof. Kosiński, I was deeply impressed by his innovative thinking, inter- 
esting and far-reaching ideas, and abilities to convey them in a highly convincing way. It is 
needless to say that he has made long-lasting contributions to the methodology of fuzzy sets 
and computing with fuzzy numbers. 


Witold Pedrycz 
University of Alberta, Edmonton, Canada 


If you asked him for help, he always tried to find the solution which is best for you. He liked 
to discuss and was always open to good arguments. He understood that the discussions at 
the conferences are an important part of the scientist’s activities. 


Piotr Prokopowicz (Former Ph.D. student) 
Kazimierz Wielki University, Bydgoszcz, Poland 


Since we worked in the same institution, quite often we met briefly, exchanging a few 
words. These everyday conversations revealed the benevolent and sociable nature of Prof. 
Witold who gladly showed interest to others, offering his support and authority whenever it 
was needed. Prof. Kosiński was a man of very open mind and flexible research, an out- 
standing scientist but also the organizer, encouraging others to activity. He was extremely 
busy but at the same time constantly smiling and bursting with a sense of humor. 


Bartłomiej Starosta (Former Ph.D. student) 
Polish-Japanese Academy of Information Technology, Warsaw, Poland 


I shall remember the Professor as a man who was always smiling, friendly and had an 
optimistic attitude towards the world. He was a man who could not imagine the proverbial 
“doing nothing.” Once during my visit at the Polish-Japanese Academy of Information 
Technology he saw that I was sitting and doing nothing, so he quickly handed to me a copy of 
some lectures saying “Krzysztof! Please read it. One must not just sit doing nothing like that.” 


Krzysztof Tyburek (Former Ph.D. student) 
Kazimierz Wielki University, Bydgoszcz, Poland 


My Dad was an exceptional person. He was active in many fields, not only of scientific 
nature. He was interested in politics, sport, followed international news, and traveled a lot 
with Mum. I could talk with him about economics, methods of valuation, and corporate 
finance. He also liked spending free time actively, so I learned and practiced skiing with 
him, I took part in numerous canoeing weekends, and I played tennis. He had been learning 
throughout his entire life, despite all the academic titles which he held. 


That’s how I shall remember him. 


W. Konrad Kosinski 
Warsaw, Poland 
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Part I 
Background of Fuzzy Set Theory 


Chapter 1 
Introduction to Fuzzy Sets 


Michal Jezewski, Robert Czabanski and Jacek Leski 


Abstract The subject of this chapter is fuzzy sets and the basic issues related to 
them. The first section discusses concepts of sets: classic and fuzzy, and presents 
various ways of describing fuzzy sets. The second section is dedicated to t-norms, 
s-norms, and other terms associated with fuzzy sets. Subsequent sections describe 
the extension principle, fuzzy relations and their compositions, cylindrical extension 
and projection of a fuzzy set. The sixth section discusses fuzzy numbers and basic 
arithmetic operations on them. Finally, the last section summarizes the chapter. 


1.1 Classic and Fuzzy Sets 


The concept of a classic set is one of primitive notions, which do not have a definition. 
Most frequently a set is understood as a collection of objects (elements) having some 
features distinguishing them from other objects, such as the set of positive numbers 
less than 100 or the set of aquatic birds. Usually, sets are denoted in uppercase (e.g., 
a set A, B,...), whereas objects are in lowercase (e.g., an object x, y, ...). Each set 
may be considered as a subset of an universe of discourse X, which is a “super-set” 
containing all possible objects. 

In the case of classic sets, a given object x may belong to a set A (be a member 
of a set A), or not belong to this set (not be a member of this set), and these two 
options are denoted by x € A or x ¢ A. A classic set may be described by means of 
the characteristic function (x4) that takes two values: 1 (for the object belonging to 
a set A), and 0 (for the object not belonging to a set A) [19] 
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l, x€A, 
XA) =] 9 ok (1.1) 


There are several operations defined on classic sets and the following are consid- 
ered to be basic ones [19]: 


e product (intersection, conjunction) 


ANB={x €X|x € Aandx €B}, (1.2) 


e sum (union, disjunction) 


AUB = {x €X|x € Aorx € B}, (1.3) 


e negation (complement) 


A={x eEX|x A}. (1.4) 


The above operations can also be defined on the basis of characteristic functions 
[19]: 


Xang = Xa (x) A XB (x) = min (xa (x) , XB )), (1.5) 
Xaus = Xa (x) V XB (x) = max (xa (x) , XB (x), (1.6) 
xa (x) = 1— xa QQ). (1.7) 


Example 1.1 Let us consider the expression “The fetal heart rate (FHR) is about 
120 bpm,” which can be described by the classic set of FHR values in the interval, 
for example, [115, 125], defined in the universe X = [0, 240] C R. The characteristic 
function of this set is shown in Fig. 1.la. According to the proposed interval, values 
121 and 125 equally belong to this set, whereas values 125.1, 130, and 135 equally 
do not belong. However, the following observations can arise: a value 121 is closer to 
120 than 125, thus it should belong “stronger”, a value 125.1 should be the member 
of the set similarly as 125, and finally, a value 135 should belong “less” than 130. 
Fuzzy sets allow for taking into account these observations. 


Fuzzy sets were introduced and described using membership functions by L.A. 
Zadeh in 1965 [24] and have many practical applications [10, 22]. As opposed to a 
classic set, in the case of a fuzzy set A an object x may belong to this set with varying 
membership degrees in the range [0, 1], where 0 and 1 denote, respectively, lack of 
membership and full membership. 

One way of describing a fuzzy set A is to provide its membership function ju, : 
X — [0, 1]. There are various membership functions, three of them are presented 
below [5, 16]. 
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e Gaussian membership function (where c and ô are parameters) 


a-o? 
la (x; c, ô) = exp (5>) ; (1.8) 


The parameter c specifies the center of a function; the parameter ô determines its 
dispersion. 
e Trapezoidal membership function (where p < q <r < s are parameters) 


0, x< p/p, 
apr P<x <q, 
Ha (x; p,q,r,s)= 41, q<x<r, (1.9) 
Sx r<x<s, 
s-r 
0, x>S. 


A special case of a trapezoidal function (for q = r) is a triangular function. 
e Singleton (where x9 is a parameter) 


1, x = x0, 


been (1.10) 


HMA (x; xo) = OPE = 


The parameter xo specifies the location of the singleton, that is, the single value 
of x which belongs to a set A (with a membership degree equal to 1). 


An example of the Gaussian membership function is presented in Fig. 1.1b, and 
trapezoidal, triangular, and singleton functions are illustrated in Fig. 1.2. 


(a) ' (b) ' 
E E 
~~ 0.5 ~~ 0.5 
XS a 
0 0 
0 60 120 180 240 0 60 120 180 240 


Fig. 1.1 “The fetal heart rate is about 120 bpm”: a the characteristic function of the classic set, b 
the Gaussian membership function of the fuzzy set 
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(a) ' (b) ' (c) ' 
= 0.5 x 0.5 Ş 0.5 
í 3 8 
0 0 
100 120 140 160 100 110 120 130 140 100 120 140 
T T T 


Fig.1.2 Examples of membership functions: a trapezoidal (p = 100, q = 120, r = 140, s = 160), 
b triangular (p = 110, g = r = 120, s = 130) and ¢ singleton (xọ = 120) 


Example 1.2 In the universe X = [0, 240] C R let us define the fuzzy set A “The 
FHR is about 120 bpm.” Such a set can be described by the Gaussian membership 
function (1.8) with c = 120 and ô = 4.25, which is shown in Fig. 1.1b. In this case, in 
accordance with observations in Example 1.1, the FHR values discussed (121, 125, 
125.1, 130, 135) belong to this set with different membership degrees: ua (121) = 
0.973, a (125) = 0.500, ua (125.1) = 0.486, ua (130) = 0.062 and u4 (135) = 
0.002. 


Example 1.3 One more example concerning fetal heart rate can be the expression 
“normal FHR,” which means that the FHR value is in the physiological range. Based 
on FIGO guidelines, as the range of “normal FHR” values we can assume [110, 150] 
bpm and use the classic set of values in this range to describe the expression “normal 
FHR.” However, this leads to the situation in which FHR value 151 bpm is not 
“normal,” although it seems that it partially is. It suggests that it is better to use a 
fuzzy set to describe the expression “normal FHR.” 


Example 1.4 Another example can be the expression “new car.” Assuming that a 
car is “new” when its age does not exceed three years, the expression “new car” can 
be described by the classic set of cars up to the age of three years. However, it results 
in a problem similar to the previous example: the car at the age of three years and 
one week is not “new,” although it seems that it almost is. Also in this case it is better 
to use a fuzzy set. 


The above examples suggest that fuzzy sets are a good tool for a formal description 
of vague and imprecise expressions such as “value about 120,” “normal FHR,” “new 
car,” “medium height,” “high salary,” and so on. Examples of membership functions 
shown in Fig. 1.2 could be used to describe expressions such as: (a) “normal FHR,” 


(b) the value of FHR is “about 120 bpm,” and (c) FHR value is “exactly 120 bpm.” 
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Another way of describing a fuzzy set is to list ordered pairs: an object x and its 
membership degree ua (x) € [0, 1] ina set A [5] 


A={(@, ua (x))| x € X}. (1.11) 


To describe a fuzzy set, the notation proposed by Zadeh [25] can also be used: 


e for discrete universe X (comprising ordered or nonordered objects) 


A= Di a (x) /x, (1.12) 
xeX 
e for indiscrete universe X 
A= fu, (x) /x. (1.13) 
X 


In the above notation the symbol / is a separator, and symbols ` and f denote 
idempotent summation. 


Example 1.5 In the discrete nonordered universe comprising selected fruits X = 
{orange, pineapple, grape, apple, peach, banana, grapefruit} letus define the 
fuzzy set A “Fruits, that the first author likes.” Using the notation proposed by Zadeh 
we can write 
A = 1.0/orange + 0.6/ pineapple + 0.2/grape + 1.0/apple + 0.8/ peach 
+0.6/banana + 0.5/grapefruit. 


Example 1.6 Letus consider the discrete ordered universe comprising values of pos- 
sible temperatures to set in a car air-conditioning system X = {low, 18, 19,..., 23 
24, high} C R4, where “low” and “high” mean the lowest and the highest attain- 
able temperatures. Using the notation of ordered pairs, the fuzzy set A “Adequate 
(according to the second author) temperature in the car” defined in the universe X 
can be described as follows 

A= {(low, 0.1), (18, 0.4) , (19, 0.5) , (20, 0.8) , (21, 0.9) , (22, 1.0) , (23, 0.8) , 

(24, 0.4) , (high, 0.1)}. 


Example 1.7 The set of FHR values from Example 1.2 using the notation proposed 
by Zadeh is described as 


A= | exp[—-—_—__, x, 
R 2+ (4.25) 
Various extensions of fuzzy sets were proposed, for example, fuzzy sets of type-2 


[26], interval-valued fuzzy sets [8, 11, 21, 26], probabilistic sets [9], rough sets [18], 
and intuitionistic fuzzy sets [2]. 
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1.2 Fuzzy Sets—Basic Definitions 


Similarly to classic sets, operations of product, sum, and complement are also estab- 
lished for fuzzy sets. Product and sum are defined by means of operators of t-norm 
and s-norm: 


rg Hane &) = pa (X) #7 ug (Œ) = T (ua (x) , ug Œ), (1.14) 
y Paue (x) = Ha &) 5 ug (Œ) = S (ua Œ) , ug (2), (1.15) 


where xr (T) and xs (S) are operators of t-norm and s-norm. Both t-norm and 
s-norm (also called t-conorm) are mappings [0, 1] x [0, 1] — [0, 1] that satisfy all 
necessary conditions [5, 16] presented in Table 1.1. 

There are various t-norms and s-norms [5, 7, 13, 16, 23, 24, 27], three that are 
frequently used are presented below. 


e Zadeh t-norm and s-norm: 
X*xepy=min(x,y)=xAy, x*esy=max(x,y)=xVY. (1.16) 
e Algebraic product and algebraic (also called probabilistic) sum: 
Xepy=xXy, XesyS=xux+y—xy. (1.17) 


Lukasiewicz t-norm and s-norm: 


X*xpy=max(x+y-—1,0), x*sy=min(x+y,1). (1.18) 

The complement of a fuzzy set A is defined as follows [5, 16] 
ug (x) =n[Ma (x), (1.19) 
where n denotes a negation function. Minimal assumptions about the function n are: 


n is a mapping [0, 1] — [0, 1], n satisfies conditions n(0) = 1, n(1) = 0, and n is 


Table 1.1 Necessary conditions for t-norms and s-norms: Al denotes boundary conditions, A2- 
commutativity, A3-monotonicity, and A4-associativity (r, u, x, y, z € [0, 1]) 


t-norm s-norm 
Al Tix, =x, T(x,0)=0 Sx, l=1, S(x,0)=x 
A2 T (x, y) =T (y,x) S(x,y) = S(y, x) 
A3 If x <u then T (x, y) < T (u, y) If x < u then S (x, y) < S (u, y) 
If y <r thenT (x,y) <T (x,r) If y <r then S (x, y) < S(x,r) 
A4 T (x, T (y,2)) =T (T œ, y),z) S(x, S(y, z)) = S (S œ, y), z) 
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(a) 1 


0.5 


HA(), MB(x) 


0 10 20 
T 


Fig. 1.3 Product, sum, and complement of fuzzy sets: a fuzzy sets A and B, b the product of A 
and B using Zadeh t-norm (minimum), ec the sum of A and B using Zadeh s-norm (maximum), d 


complement of a set A using the standard negation 


nonincreasing. Depending on specific conditions [5, 16], a negation function can be 
strict or strong. The strong negation in the form N (x) = 1 — x (a standard negation) 
is most frequently used. Operations of product, sum, and complement are illustrated 


in Fig. 1.3. 
In addition to definitions of t-norms and s-norms, other concepts that also char- 


acterize fuzzy sets are defined [3, 5-7, 16, 20, 23, 27]. Some of them are discussed 


below. 


e Ana-cut set (Aq) and a strong a-cut set (Ag) 
Aa = {x € X| ua x) 2 a}, Aa = {x € X| ua (x) > a}. (1.20) 


e Core of a fuzzy set (Core(A)), that is, the -cut set with œ = 1. 
e Support of a fuzzy set (Supp(A)), that is, the strong a-cut set with a = 0. 
e Width of a fuzzy set, Width(A) = |x2 — x,|, where xı and x2 are crossover points 


of A defined below. 
e Crossover points of a fuzzy set 


Crossover (A) = {x eX hs (x) = ; | ; (1.21) 
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e A fuzzy set is “normal” if its core is not empty. 
e A fuzzy set A is “convex” if and only if (iff) 


v V pal + (L— A) x2] > min [ua 1), ua Q2)]. (1.22) 
X1, X2EX A€[0, 1] 


e Two fuzzy sets A and B are equal iff 


Y, AG) = Ma). (1.23) 


e A fuzzy set A is a subset of a fuzzy set B iff 
V fa (X) S Me (x). (1.24) 
xEX 
Core(A), Supp(A), Width(A), and Crossover(A) are illustrated in Fig. 1.4. It is worth 


noting that Core(A) and Supp(A) specify classic sets (Xcore(a)(X) and Xsupp(a)(X) in 
Fig. 1.4 denote their characteristic functions). 


XSupp(A) (x) 


XCore(A) (£) 


ne Width(A) 


0 nal 50 v2 100 
x Crossover (A)={21,2 2} 


Fig. 1.4 The illustration of core, support, width, and crossover points of a fuzzy set 
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1.3 Extension Principle 


The extension principle [26] allows for extension of the concept of mathematical 
functions (defined on classic sets) to fuzzy sets. In other words, mapping from a 
classic set to a classic set is extended to mapping from a fuzzy set to a fuzzy set. 

Let y = f(x) be a one-argument function, which is mapping from X to Y, and A 
be a fuzzy set defined in a discrete universe X = {x1, Rosch KG Xp} 


A = na (x1) [x1 + ua (x2) /x2 + -+ + ua (xp) /Xp- (1.25) 


As a result of mapping a set A by the function f we obtain the following fuzzy 
set B (defined in the universe Y) [16] 


B = f (A) = wa &1) /f G1) + ua 2) /f G2) +: + ua (Xp) /f (Xp), (1.26) 


where + denotes a logical sum. For functions that are not injective (are not one-to-one 
mappings), a logical sum is performed using s-norm, and hence we can write [16] 


ws maa), STO) AY, 
Lp (Y) = 4 I=} (1.27) 


0, fŒ O)=ð, 


where xs stands for a multiargument s-norm, and f~! (y) denotes the domain of 
function y = f(x). 


Example 1.8 Suppose we have a fuzzy set A defined in the discrete universe X = 
{—3, —2,...,3,4 CR 

A = {(x1 = —3, 0.8) , (x2 = —2, 0.5) , (x3 = —1, 0.3) , (x4 = 0, 0.5), 

(x5 = 1, 0.8) , (x6 = 2, 0.1) , (x7 = 3, 0.8) , (xg = 4, 0.7)}, 
and the function y = f(x) = 2x4, which is the mapping from X to Y. Let us deter- 
mine the mapping of A by the function f to the fuzzy set B. 

Values of the function f arranged in ascending order are 

f (x4) =0, f) = fs) =2, f 2) = f (x6) = 32, fx) = far) = 162, 

f (xg) = 512. 

Using (1.27) and Zadeh s-norm (maximum), the fuzzy set B is determined in the 
following way 

B = {(0, 0.5) , (2, max (0.3, 0.8)) , (32, max (0.5, 0.1)) , (162, max (0.8, 0.8)) , 

(512, 0.7)} = {(0, 0.5) , (2, 0.8) , (32, 0.5) , (162, 0.8) , (512, 0.7)}. 


The above description concerned a one-argument function. Now let us consider a 
general case, a multiargument function y = f (x1, X2,...,%,), which is a mapping 
from X; x X2 x --- x X, to Y. Suppose we have fuzzy sets A1, Az, ..., An, defined 
in universes X1, X2, . . . , Xn, respectively. The mapping of these sets by the function 
f leads to the following fuzzy set B (defined in universe Y) [16] 
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Ks [Ma (x1) kr + xT MA, Ga) , F'O) ZD, 
lB (Y) = 7 (Gt f Ot =Y} 
0, f'o) =. 
(1.28) 


1.4 Fuzzy Relations 


A generalization of the concept of a fuzzy set is the idea of a fuzzy relation [26]. Let 
us consider a two-dimensional (binary) fuzzy relation R, which can be described by 
the set of ordered pairs: two objects x and y, and the membership degree upr (x, y). 
It can be written as [5, 16] 


R={[(@, y), ur &, y)]|x € X, y € Y}. (1.29) 


The membership degree upr (x, y) can be understood as the degree of relationship 
between objects x and y; the higher the value of upg (x, y), the greater is the degree 
of relationship. The membership degree upg (x, y) is the value of membership func- 
tion upr : X x Y > [0, 1] of fuzzy relation R. The presented two-dimensional fuzzy 
relation is also a two-dimensional fuzzy set defined in an universe X x Y. 


Example 1.9 In universes X = Y = [100, 160] c Ry let us define the two- 
dimensional fuzzy relation R “Two FHR values (x and y) differ significantly.” As 
the membership function of such a relation we can assume 


an 
ur (x, y)=1 exp ( wa). 


which for parameter 6 = 0.2 is shown in Fig. 1.5. 


Example 1.10 Let us consider two discrete universes: X = {3500, 4000, 4500, 
5000} c R, and Y = {2000, 3000, 3500, 5000, 5500} c R+, comprising possible 
salaries in companies A and B, respectively. In universe X x Y we can define the 
following fuzzy relation “The salary of an employee x in a company A is similar to 
the salary of an employee y in a company B.” 

A relation defined in discrete universes can be described by a relation matrix. In 
this case it is as follows 


0.32 0.88 1.00 0.32 0.14 
0.14 0.61 0.88 0.61 0.32 
0.04 0.32 0.61 0.88 0.61 
0.01 0.14 0.32 1.00 0.88 
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Fig. 1.5 Example of the 
membership function of 
two-dimensional fuzzy 
relation R “Two FHR values 
(x and y) differ 
significantly” 


where rows correspond to elements of the universe X, and columns to elements of the 
universe Y. In other words, the element R(i, j) determines the degree of relationship 
between the ith object in X and the jth object in Y. 


In general, a multidimensional fuzzy relation is defined as follows [5, 16] 
R = {[(%1, 2, ---,4n), MR (X1, X2, -+ +, Xn)]| x1 € X1, x2 € X2, ..., Xn E Xn}, — (1.30) 


where upr : Xı x Xp x --- x X, — [0, 1] is a membership function of an n-dimen- 
sional fuzzy relation R, that is, of an n-dimensional fuzzy set defined in universe 
Xi xXx e xX. 

Because fuzzy relations are fuzzy sets, they are subject to the same operations 
as fuzzy sets, for example, the product of sets or an -cut set. Additionally, fuzzy 
relations may be composed. Let R; and R, be relations defined in universes X x 
Y and Y x Z, respectively. Frequently used compositions are “supremum-f-norm”’ 
(Rı o R2) and “infimum-s-norm” (R, e R2), leading to the relation defined in an 
universe X x Z [16]: 


HRioR, (X, z) = sup [ur (X,Y) *r ur O, 2)], (1.31) 
ye 
Lrier (x, 2) = inf [ur (x,y) *s ur O, 2|. (1.32) 


For relations described by relation matrices, the above compositions can be 
achieved by multiplication of matrices with multiplication of elements replaced by 
t-norm (or s-norm), and the adding of elements replaced by maximum (or minimum). 


Example 1.11 Suppose we have two fuzzy relations: Rı and R, defined in discrete 
universes X = {x1, x2, x3} x Y={y1, yo} and Y= {y1, yo} x Z = {z1, z2; z3}, 
respectively, which are described by relational matrices: 
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n 0.5 0.7 0.2 
Rı=]ļ|01 10], R = 10 02 08l 
0.6 0.5 ` ` i 


The composition “maximum-t-norm” (R; o R2) with Zadeh t-norm (minimum) 
leads to the following relation 


0.5 0.5 0.2 
Rio R = | 1.0 0.2 0.8 |, 
0.5 0.6 0.5 


where, for example, element (1, 1) was determined as 
max (min (0.5, 0.5) , min (0.2, 1.0)) = max (0.5, 0.2) = 0.5. 


1.5 Cylindrical Extension and Projection of a Fuzzy Set 


When analyzing fuzzy sets (fuzzy relations) defined in universes of different dimen- 
sionality, sometimes there is a need to increase or reduce dimensionality of one of 
the sets (one of the relations). To increase or reduce dimensionality, operations of 
cylindrical extension and projection were defined [26]. 

Cylindrical extension of a fuzzy set A leads to a fuzzy set (denoted by Ce(A)) 
of higher dimensionality. Let us assume we have a fuzzy set A defined in a one- 
dimensional universe X. Its cylindrical extension in two-dimensional universe X x Y 
is defined as [16] 

Vo Mece(a) (x, y) = ua x), (1.33) 
xEX,yceY 
and is illustrated in Fig. 1.6a, which shows the cylindrical extension of the fuzzy set 
A from Example 1.2 in the universe X x Y, where Y = [0, 50] C R. 


Example 1.12 Let us consider the cylindrical extension of the fuzzy set A from 
Example 1.6; that is, 
A= {(low, 0.1) , (18, 0.4) , (19, 0.5) , (20, 0.8) , (21, 0.9) , (22, 1.0) , (23, 0.8), 
(24, 0.4) , (high, 0.1)}, 
in the universe X x Y, where Y = {1,2} C R4. 
Using (1.33) the following fuzzy set is obtained 
Ce(A)=0.1/ (low, 1) +0.4/ (18, 1) +0.5/ (19, 1) +0.8/ (20, 1) +0.9/ (21, 1) + 
+1.0/ (22, 1) + 0.8/ (23, 1) + 0.4/ (24, 1) + 0.1/ (high, 1) + 
+0.1/ (low, 2) + 0.4/ (18, 2) + 0.5/ (19, 2) + 0.8/ (20, 2) + 0.9/ (21,2) + 
+1.0/ (22, 2) + 0.8/ (23, 2) + 0.4/ (24, 2) + 0.1/ (high, 2). 


In general, let us assume we have a fuzzy set A defined in an m-dimensional 
universe X = X; x X2 x --- x Xm. The cylindrical extension of A in an m +n- 
dimensional universe XY = X x Y, where Y = Yı x Y2 x --- x Y,, is defined 
as [16] 
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(a) (b) Proj, (A) Proj (A) 


HCe(A) (x, y) 
ualz,y) 


Fig. 1.6 Cylindrical extension (a) and projection of a fuzzy set (b) 


V Hcea) (Xxy) = Ha (Xx) (1.34) 


XyyeEXY 


where x yy and xy denote objects from universes XY and X, respectively. 

Projection of a fuzzy set [26] leads to fuzzy sets of lower dimensionality. For 
example, let us consider a fuzzy set A defined in a two-dimensional universe X x Y 
and described by the membership function presented in Fig. 1.6b. As a result of its 
projection in universes X and Y we can obtain two fuzzy sets [16]: 


Y MProjx(A) Œ) = Supa (x, y), (1.35) 
xeEX yeY 
and 
V [projy(A) Y) = supna (x, y), (1.36) 
yeY xeX 


which are also illustrated in Fig. 1.6b. 


Example 1.13 In Example 1.11, the fuzzy relation R; defined in the universe X = 
{x1, x2, x3} x Y = {y1, y2} was presented 


0.5 0.2 
Rı = | 0.1 1.0 
0.6 0.5 


As a result of its projection in universes X and Y, according to (1.35) and (1.36) the 
following fuzzy sets can be obtained. 

Projy (Ri) = max (0.5, 0.2) /xı + max (0.1, 1.0) /x2 + max (0.6, 0.5) /x3 = 

= 0.5/x; + 1.0/x2 + 0.6/x3, 

Projy (Ri) = max (0.5, 0.1, 0.6) /yı+ max (0.2, 1.0, 0.5) /y2 = 0.6/yı+1.0/y2. 
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In general, let us assume we have a fuzzy set A defined in an (m + n)-dimensional 
universe XY = X x Y. Its projection in an m-dimensional universe X is defined 
as [16] 


V Hoja) (Xx) = SUP HLA (Xyxy), (1.37) 
xyeX xyeY 


where xy, xy, and x yy denote objects from universes X, Y, and XY, respectively. 


1.6 Fuzzy Numbers 


A separate class of fuzzy sets for describing imprecise expressions related to numbers 
(such as “about 5,” “more or less 10,” etc.) is distinguished [26]. Such sets are called 
fuzzy numbers and denoted by A, B,... [16]. Usually, fuzzy numbers are regarded as 
fuzzy sets that are defined over the real axis and fulfill given conditions; for example, 
they are normal, compactly supported, and in some sense convex [15]. 

Basic operations on fuzzy numbers A and B can be defined based on the extension 
principle in the following way [16]: 


e addition 
Mies (= sup [wa (x) *r wg], (1.38) 
{@.y)|at+y=z} 
e subtraction 
Mion) = sup [wa (x) *r uz )], (1.39) 
{(x,y)|x-y=z } 
e multiplication 
Migs = sup [ua œ >r ug], (1.40) 
{œ y)lxy=z } 
e division 
Hio ©) = sup [aa @) 7 wa ODI. (1.41) 
(x, y)|x/y=z 


Example 1.14 Let us calculate addition, subtraction, multiplication, and division of 
the following fuzzy numbers. 


A=0.5/—2+1.0/—1+4+0.5/0, 
B = 0.8/4 + 1.0/5 + 0.8/6. 
It can be noticed that the first number represents a value “about —1” and the 


second one “about 5,” because membership degrees for —1 and 5 are equal to 1. 
Useful calculations are presented in Table 1.2. 
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Table 1.2 Arithmetic operations on fuzzy numbers defined based on the extension principle 


x y Hx (x) ug O) x+y y—x xy y/x 
—2 4 0.5 0.8 2 6 -8 =32 
-2 5 0.5 1.0 3 7 —10 —2.5 
-2 6 0.5 0.8 4 8 —12 -3 
-1 4 1.0 0.8 3 5 —4 =4 
—1 5 1.0 1.0 4 6 -5 -5 
-1 6 1.0 0.8 5 7 —6 —6 
0 4 0.5 0.8 4 4 0 - 

0 5 0.5 1.0 5 5 0 = 

0 6 0.5 0.8 6 6 0 - 


Using (1.38) and Zadeh t-norm (minimum), values of the membership function 
of the sum are calculated as follows: 
sup [min (0.5,0.8)], sup [min (0.5, 1.0) , min (1.0, 0.8)], 
x+y=2 x+) 
sup [min (0.5, 0.8) , min (1.0, 1.0) , min (0.5, 0.8)], 


x+y=4 
sup [min (1.0, 0.8), min (0.5, 1.0)], sup [min (0.5, 0.8)]. 
x+y=5 x+y=6 


Finally we get 

Uīeğ Z) = 0.5/2 + 0.8/3 + 1.0/4 + 0.8/5 + 0.5/6. 

Values of the membership function of the subtraction, multiplication, and division 
are calculated similarly applying (1.39)—(1.41); final results are given below: 

LBoad Z) = 0.5/4 + 0.8/5 + 1.0/6 + 0.8/7 + 0.5/8, 

Hī Z) = 0.5/ — 12 + 0.5/ — 10 + 0.5/ — 8 + 0.8/ — 6 + 

1.0/ — 5 + 0.8/ — 4+ 

+0.5/0, 

LBA Z) = 0.8/ — 6 + 1.0/ — 5 + 0.8/ — 4 + 0.5/ — 3 + 0.5/ — 2.5 + 0.5/ — 2. 

It can be noted that the obtained results represent values: “about 4” (for the sum), 
“about 6” (subtraction), “about —5” (multiplication and division), which is consistent 
with classic arithmetic, for example, “about —1” + “about 5” = “about 4.” 

The considered arithmetic operations were defined based on the extension princi- 
ple. Alternatively w-cuts of fuzzy numbers can be used. Figure 1.7a shows an a-cut of 
a fuzzy set A (see (1.20) in Sect. 1.2). According to the figure, as a result of an a-cut 
a classic set described by the interval [a-, a] is obtained. Arithmetic operations 
on fuzzy numbers A and B using &œ-cuts consist in application of interval arithmetic 
to intervals describing a-cuts of these numbers: Aw = [a_, a] and By = [b_, b]. 
According to [1] arithmetic operations are defined as follows: 


(A@ B), =[a@_+6_,a, + b4], (1.42) 
(4e B), =[a_ —b,,a, — b], (1.43) 
(A @ B) = [min (4_b_, a. b,,G,b_,G,b,), 
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Fig. 1.7 Arithmetic operations on fuzzy numbers using a-cuts 
max (@_b_,a_b,,G,b_,@,b,)], (1.44) 
(A @ B), = [min (@_/b_, a_/b,, a/b 


max (@_/b_, @_/b,,a,/b_-,a,/b,)],  if0¢[b_,b,]. (1.45) 


Example 1.15 Suppose we have two fuzzy numbers described by triangular mem- 
bership functions: 


MK (x) = wg (x; 2, 3,4), 
ug (x) = ug (x; 4,5, 7), 


which are presented in Fig. 1.7b. Let us calculate addition, subtraction, multiplication, 
and division of A and B using their a-cuts. 
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Based on equations of straight lines including sides of triangles we get intervals 
describing a-cuts of A and B (for any « in the range [0, 1]): 

Aa = [a+2,-a+4], By = [a +4, -—2a@ + 7]. 

Applying (1.42) we get the interval 


(A @ B), = [20 + 6, —3a + 11], 
where limits are functions describing locations of the beginning and the end of the 
interval describing an a-cut of the sum. Because functions are linear, replacing a 
with 0 and 1 provides parameters of the triangular membership function of the sum 

hīa (X) = Migs (X; 6, 8, 11), 
which is shown in Fig. 1.7c. 

In a similar way, using (1.43) the results of the subtraction are obtained: 
the interval 

(A (S) B), = Ba — 5, —2a] 
and the membership function 

Hīog (x) = Hīog X; —5, —2, 0), 
which is presented in Fig. 1.7d. 

Determining the product requires more comments. Applying (1.44), the minimum 
and the maximum are searched among functions: a? + 6a + 8, —2a? + 3a + 14, 
—a? + 16 and 2a? — 15a + 28. From the analysis of values of these functions for a 
in the range [0, 1] the following interval is obtained 

(A 8 B), = [a? + 6a + 8, 2a? — 15a + 28]. 

Limits of the above interval are not linear functions, thus replacing œ with 0 and 
1 provides only values of x, for which the membership function takes values 0 
and 1; that is, “7% (8) = 0, UxeR (15) = 1 and u žog (28) = 0. To determine the 
membership function of the multiplication 1.72% (x), the following equations should 
be solved (with respect to a): 

a? + 6a +8 = x, 2a* — 15a + 28 = x. 

The solutions are as follows: œ1,2 = (-3 +Y1+ x) for the first equation, anda). = 
(15 zV1+ 8x) /4 for the second. In the case of the first equation, the function 
(-3 +s 1 + x) is chosen as the membership function because it provides values in 
the range [0, 1] for x € [8, 15]. Considering the second equation, for x € [15, 28] the 
values in the range [0, 1] are provided by the function (15 —J1l+ 8x) /4. Finally, 
the product is described by the following membership function 


=3 +y l+ x, 8 <x <15, 
Mie (x) = į (15 — VIF 8x) /4, 15 < x < 28, 
0, x<8 or x > 28, 


which is shown in Fig. 1.7e. 

The result of the division is calculated similarly applying (1.45), however, there 
is no need to select solutions of equations since each of them has a single solution. 
Finally, we get the membership function 
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2 
BH, 3x <06, 
So — J 4a- 
Miog œŒ) = ] 42, 0.6 <x <1, 
0, x<4 or x > 1, 


which is presented in Fig. 1.7f. 

Analyzing membership functions of the considered fuzzy numbers A and B it can 
be noted that they represent values “about 3” and “about 5,” because membership 
degrees for 3 and 5 are equal to 1. The obtained results of arithmetic operations are 
correct; for example, the subtraction provided value “about —2.” 


As opposed to classic arithmetic, where two numbers are equal or are not equal, in 
fuzzy arithmetic a “partial equality” is possible. One of the methods of determining 
the degree of equality is based on the distance between compared fuzzy sets [16]. 
According to it, the equality index of sets A and B is defined as Eq; (A, B) = 
1 — d, (A, B), where d, (A, B) denotes Minkowski distance between sets described 
by membership functions u4 (x) and upg (x) 


1 
p 


dp (A, B) = fima œŒ- us ŒP dx] , p>l. (1.46) 


Minkowski distance between sets is also the basis of one of the methods of ranking 
fuzzy numbers [16]. . According to it, to compare fuzzy numbers A and B, the fuzzy 
number C such as A < C and B < C is established. The comparison of A and B 
consists in the analysis of their Minkowski distances from C; it is stated that A<B 
if dp (A, C) > dp (B, ©). Most often C = max (A, B) is established based on the 
extension principle [16] 


Mmax(4,B) E) = sup [uz (x) er uz o). (1.47) 
{(x, y)|max(x, y)=z } 


Another way of ranking fuzzy numbers is to use their a-cuts [23]. 

The extension of the concept of fuzzy numbers are Ordered Fuzzy Numbers 
(OFNs) proposed in [14, 15]. The OFNs are ordered pairs of continuous real functions 
defined on the interval [0, 1] and their applications are the subject of research [4, 12, 
17]. 


1.7 Summary 


The chapter provides the review of basic issues concerning fuzzy sets, which — 
contrast to classic sets — allow for partial membership of objects. As a result fuzzy 
sets are a good tool for representing vague and imprecise expressions of natural 
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language. Various ways of describing fuzzy sets and concepts related to them were 
shown. We discussed the extension principle, which allows for extension of tradi- 
tional mathematical functions to fuzzy sets, as well as the idea of fuzzy relation, 
which makes possible a formal description of the relationship between two or more 
fuzzy sets. Operations of cylindrical extension and projection of a fuzzy set, which 
enable increasing and reducing its dimensionality, were also described. A separate 
section was dedicated to fuzzy numbers and basic arithmetic operations on them. 
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Chapter 2 
Introduction to Fuzzy Systems 


Robert Czabanski, Michal Jezewski and Jacek Leski 


Abstract The following chapter describes the basic concepts of fuzzy systems and 
approximate reasoning. The study focuses mainly on fuzzy models based on Zadeh’s 
compositional rule of inference. The presentation begins with an introduction of fun- 
damental ideas of fuzzy conditional (if-then) rules. A collection of fuzzy if-then rules 
formulates the so-called knowledge base, which formally represents the knowledge to 
be processed during approximate reasoning. The subsequent sections present formal 
definitions related to the compositional rule of inference and approximate reasoning 
using a knowledge base. Theoretical considerations are supplemented with practical 
examples of fuzzy systems as the foundation of many modern structures. The descrip- 
tion includes fuzzy systems proposed by Mamdani and Assilan, Takagi, Sugeno and 
Kang, and Tsukamoto. 


2.1 Introduction 


The main inspiration behind the introduction of fuzzy sets theory was the necessity 
for modeling real-world phenomena, which are inherently vague and ambiguous. 
Human knowledge about complex problems can be successfully represented using 
the imprecise terms of natural language. The theories of fuzzy sets and fuzzy logic 
provide formal tools for mathematical representation and efficient processing of such 
information. 

The term “system” is usually understood as a set of interacting components with 
well-defined structure and organized as an intricate whole that can be distinguished 
from the “external” environment. A system communicates with the environment 
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Fig. 2.1 The typical structure of a fuzzy system 


through so-called inputs and outputs. Fuzzy systems are structures based on fuzzy 
techniques oriented towards information processing, where the usage of classical 
sets theory and binary logic is impossible or difficult. In the literature, terms such as 
fuzzy system, fuzzy model, system based on fuzzy rules, fuzzy controller, or fuzzy 
associative memory are used interchangeably depending on the application type [16]. 
Their main characteristic involves symbolic knowledge representation in a form of 
fuzzy conditional (if-then) rules. 

The typical structure of a fuzzy system (Fig. 2.1) consists of four functional blocks: 
the fuzzifier, the fuzzy inference engine, the knowledge base, and the defuzzifier. Both 
linguistic values (defined by fuzzy sets) and crisp (numerical) data can be used as 
inputs for a fuzzy system. If crisp data are applied, then the inference process is pre- 
ceded by fuzzification, which assigns the appropriate fuzzy set to the nonfuzzy input. 
The values of input variables are mapped into linguistic values of the output variable 
by means of the appropriate method of approximate reasoning (inference engine) 
using expert knowledge, which is represented as a collection of fuzzy conditional 
rules (knowledge base). In addition to the linguistic values, the numerical data may 
be required as the fuzzy system output. In such cases defuzzification methods are 
used, which assign the representative crisp data to the resultant output fuzzy set. 

Practical applications of fuzzy systems include problems for which the complete 
mathematical description is unavailable, or where the usage of the precise (non- 
fuzzy) model is uneconomical or highly inconvenient. The ability to process inac- 
curate information makes a fuzzy system an excellent tool, for example, for control 
processes [12, 19], system identification [11, 20], decision support [24, 33], and 
signal and image processing [4, 23]. 

In the following sections only static fuzzy systems (i.e., systems where the outputs 
are determined only on the basis of the current input values) are considered. Included 
are concepts of knowledge representation in the form of fuzzy conditional rules, 
the idea of approximate reasoning, and the description of basic structures of fuzzy 
systems. 
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2.2 Fuzzy Conditional Rules 


One of the fundamental concepts of fuzzy sets theory is a linguistic variable [34]. Its 
values are the statements of natural language (terms), which are the labels (descrip- 
tions) of fuzzy sets defined on a given universe (space) of discourse. Formally, a 
linguistic variable is defined as a quintuple [35]: 


X =(V,2L(G),X,G,S), (2.1) 


where .V is a name of the linguistic variable, -Z (G) denotes the family of values 
of the linguistic variable being a collection of labels of the fuzzy sets defined on the 
universe X, G is the set of syntactic rules defined by a grammar determining all terms 
in -Z (G), and S represents the semantics of the variable X, that defines the meaning 
of all labels. 

As an example we can use a linguistic variable describing the fetal heart rate 
(FHR). The name of the variable can be defined as .V = “mean FHR”. According 
to FIGO guidelines [21], the set of possible linguistic values is a collection of three 
labels describing the fetal state as: & = {“normal,” “suspicious,” “pathological” }. 
To each of the labels we can assign a fuzzy set A; : i = 1,2,...,5, defined on 
X = [0, 250] bpm, which represents the range of possible number of heart beats per 
min [3]. The examples of membership functions ma, (x) of the fuzzy sets A; are 
shown in Fig. 2.2. 

An elementary statement for the linguistic variable X is the fuzzy expression: 


Xis La, (2.2) 


where L4 is a label from the collection &(G), defined by a fuzzy set A on the 
universe X. The logical value of the expression is determined on the basis of mem- 
bership function u4 (x) of the fuzzy set A. In the preceding example, an elementary 
statement is: 


Hal), 
Pathological Suspicious Normal Suspicious Pathological 


1.0 


wy H 


100 110 150 170 


> 
bpm 


Fig. 2.2 Examples of membership functions of fuzzy sets defining the values of the linguistic 
variable X = “mean FHR” 
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“mean FHR” is “normal”, 


which value for the measurement 110 bpm is equal to u4, (x) = 0.5 (see Fig. 2.2). 
A more complex fuzzy expression can be obtained by combining two or more 
elementary expressions. It can be presented in the conjunctive: 


(X, is L4,) and (Xz is Ly,), (2.3) 


or the disjunctive form: 
(X, is L4,) or (Xz is La,), (2.4) 


where X1, X2 are linguistic variables with labels L4,, La, defined by the fuzzy sets 
A, and A3, respectively, on the universes X; and X32. 

The value of a complex fuzzy expression for x; € X; and x2 € X3 is determined 
on the basis of the membership functions of fuzzy sets A; and A» [16]: 


Ma, (X1) *T Ha, X2), (2.5) 


for the conjunctive form, and 


Ha, (X1) *s Ha, 2), (2.6) 


for the disjunctive form, where xr denotes a t-norm, and *s an s-norm. 
An elementary fuzzy statement can also be expressed in the form of an implication 
forming a fuzzy if-then rule (fuzzy conditional statement): 


if (X is L4), then (Y is Lz), (2.7) 


defining a relationship between linguistic variables. The statement “X is L4” is 
called the antecedent (premise), and the statement “Y is Lg” is called the consequent 
(conclusion). 

A generalized form of the fuzzy conditional statement can be defined as an impli- 
cation of complex fuzzy expressions. For the conjunctive form it can be written 
as: 


if (X, is L4,) and (X2 is L4,) and --- and (Xy is La,), (2.8) 
then (Y; is Lg,), (Y2 is Lp,),-.., (Ym is Lg, ), 


and for the disjunctive form as: 


if (X, is L4,) or (X2is L,,) or --- or (Xy is Lay), (2.9) 
then (Y; is Lg,) , (Y2 is Lg,), ---, (Ym is Lgu), 
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where X1, X2,..., Xy are the input linguistic variables; Y1, Y2,..., Ym are the out- 
put linguistic variables; L4,, L4,,..., Lap and Lpg, Lz,,..., Lpy are their linguis- 
tic values, defined with fuzzy sets A4, A2,..., Ay and B,, Bo,..., By on universes 


X1, Xo,..., Xy, and Y1, Yo,..., Ym, respectively. 

Both implications are the fuzzy if-then rules with multiple inputs and multiple 
outputs (MIMO). The MIMO fuzzy rule can be decomposed into the corresponding 
set of canonical fuzzy if-then rules [16], which are the MISO (multiple inputs and 
single output) type of fuzzy conditional statements with conjunctive antecedent: 


N 
if and (X, is L4,) , then Y is Lg. (2.10) 


n=1 
Canonical fuzzy conditional statements are the basics for representing expert 


knowledge in a fuzzy system. Using pseudo-vector notation, the canonical fuzzy 
if-then rule can be written as 


if (Xis La), then (Y is Lz), (2.11) 
which is an N + 1-nary fuzzy relation [4]: 


R= ((A; x A2 x +++ x Ay) = B) = (A = B), (2.12) 


defined on X; x Xz x --- x Xy x Y, with the membership function: 


LR (x1,...,%N, Y) = È (ua Q) , MB (y)), (2.13) 


where x = [x),..., xv]? € X1 x X2 x- x Xy, y € Y, and depending on the 
interpretation of the fuzzy if-then rule, ® (-, -) denotes a t-norm (a conjunctive inter- 
pretation) [8, 16] or fuzzy implication (logical interpretation) [8, 9, 16]. 

If the conjunction “and” in the antecedents of the fuzzy if-then rules is represented 
by a t-norm T, then: 


Ha (X) = Ma, (X1) *T HA, (X2) *T `+: *T May (XN), (2.14) 


where Aj, A2, ..., Ay are fuzzy sets representing the values of linguistic variables 
in the antecedent of the canonical fuzzy rule. 
Hence, for the conjunctive interpretation we get: 


Ur (X, y) = HR (X1, ---, XN, Y) = Ma (X) *r, UB (Y) = 
Ma, (X1) *T HA, (X2) T+ eT Hay (XN) *T, UB (Y), (2.15) 


where xy, is a t-norm representing the fuzzy if-then rule, whereas for logical inter- 
pretation: 
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Ler X, y) = Mr (X1,.--, XN, Y) = Y (Ma X), uB Y)) = 
W (ua (X1) *T Ma, (X2) *T eT Hay XN), uB Y)), (2.16) 


where W (., -) denotes a fuzzy implication. 

Fuzzy implication is usually introduced using an axiomatic approach [9], where 
it is defined as a continuous function W : [0, 1] x [0, 1] — [0, 1], which for each 
a,b,c € [0, 1] fulfills five necessary (general) conditions: 


Pl: ifa<c,thenW (a,b) >W(c,b), 
P2: ifb<c,thenW (a,b) < ¥ (a,c), 
P3: wW(0,b)=1, 
P4: ¥(a,1)=1, 
P5: W¥(1,0)=0, 


and eight recommended (specific) conditions [4]. Properties P3, P4, and P5 are 
called falsity, neutrality, and Booleanity, respectively [4, 22]. As examples we can 
use Lukasiewicz: 

W (a,b) = min (1 — a +b, 1), (2.17) 


Reichenbach: 
W (a,b) =1—a-+ab, (2.18) 


and Zadeh fuzzy implication: 


W (a, b) = max (1 — a, min (a, b)). (2.19) 


A single fuzzy rule describes a local relationship between the input and output 
variables of the fuzzy system within the limits defined by the domain of fuzzy sets 
in the rule antecedent. The complete input-output mapping is represented by the 
whole collection of fuzzy if-then rules from the knowledge (rule) base. For further 
considerations we assume a base consisting of J rules in the form: 


N ale 
R={R} = lir and (X, is L{)), then Y is x9 . (2.20) 
n= 1 


i= 


A well-defined fuzzy rule base should be complete, consistent, and continuous 
[31]. The completeness means that for each value from the input space at least one 
rule is activated, that is dj21.2,..7 aw (x) Æ 0. The knowledge base is consistent 
if there are no rules with the same antecedent but different consequents. And finally, 
the knowledge base is continuous if there are no neighboring rules, for which the 
result of intersection of fuzzy sets in their consequents is an empty set. 

The knowledge base is constructed first by acquiring knowledge about the mod- 
eled phenomenon, and next by representing it in a form of fuzzy conditional rules. 
In practice, there are three basic methods to create a fuzzy rule base [16]: 
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e by using knowledge of a human expert or based on the physical laws describing 
the phenomenon (white box modeling), 

e by automatically extracting the rules based on numerical data representing the 
relationship between inputs and outputs of the phenomenon (black box modeling), 

e mixed, where part of the knowledge is derived from a human expert and part from 
automated extraction (grey box modeling). 


The possible applications of a fuzzy system depend, however, not only on the 
properly defined knowledge base, but also on the appropriate design of an inference 
engine. 


2.3 Approximate Reasoning 


Inference methods originating from classical logic are based on so-called rules of 
inference. A rule of inference is a pattern of reasoning that explains how a conclusion 
may be logically derived from a given premise previously assumed to be true. One of 
the most commonly used rules of inference is the rule of detachment, often referred 
to as modus ponendo ponens (“the way that affirms by affirming”). Modus ponendo 
ponens (MPP) is based on two premises. The first is the conditional statement p —> 
q, namely that “p implies q”. The second assumes that the antecedent p of the 
conditional statement is true. From these two premises it can be concluded that the 
consequent g is true. The MPP rule can be written as [4]: 


Premise I (fact): p 
Premise II (rule): p => q 
Conclusion: q 


or symbolically: 
(pA (:p => q4) => 4. (2.21) 


Binary logic assumes only two possibilities: total compliance or total noncompli- 
ance of the fact with the implication antecedent. In contrast, fuzzy inference engines 
use an approximate reasoning based on the generalized rules of inference. The gen- 
eralized modus ponendo ponens (GMPP) may be written as [34]: 


Premise I (fact): p’ 
Premise II (rule): p => q 
Conclusion: q 
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or: 


[Pa o => Ao] d, (2.22) 


where statements p’ and q’ are similar, respectively, to p and q. 

A conditional fuzzy rule can be defined as a fuzzy relation, and hence, the state- 
ments in antecedents and consequents as fuzzy sets. The statement X is L y is a fact, 
where L 4 denotes the label of a linguistic variable X defined by a fuzzy set A’ on 
the universe X. The knowledge is represented by the fuzzy conditional rule “if X is 
La, then Y is Lg,’ where L4 and Lz are the linguistic values of linguistic variables 
X and Y, defined by fuzzy sets A and B, on the universes X and Y, respectively. 
Consequently, the inference scheme of GMPP takes the form: 


Premise I (fact): X is Ly 
Premise II (rule): if X is L4, then Y is Lg 
Conclusion: Y is Lp 


or: 
[(X is La) A (X is Ly => Y is Lg)] => Y is Lp. (2.23) 


The fuzzy set B’ is determined using Zadeh’s compositional rule of inference [34]. 


2.3.1 Compositional Rule of Inference 


The compositional rule of inference (CRI), also known as supremum-star composi- 
tion [34], is a generalization of an operation for determining the function value. The 
first stage of CRI is to construct a cylindrical extension of a fuzzy set A’ (x) from 
the universe X to X x Y: 


' = Ma (x). 2.24 
(x,y)EXxY Eee X, y) = Mar (x) ( ) 


Secondly, an intersection (logical product) of cylindrical extension Ce (A’) and fuzzy 
relation R is constructed using t-norm T: 


Lece(Aynr (xX, yY) = Mecea’) (X, Y) *r UR (x, y) (2.25) 
(@yeXxY = uy (x) er UR (X, y). l 


The final CRI outcome is a result of the Ce (A’) N R projection on Y: 


ty O= sup [Mar (x) *r ur (x, y)]. (2.26) 
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The fuzzy set B’ can also be presented as a composition of a fuzzy set A’, which is 
an unary fuzzy relation, with conditional fuzzy rule R being a binary fuzzy relation: 


B’=A'oR, (2.27) 


where o is the operator of the supremum-t-norm composition. 
The GMPP for the ith canonical fuzzy if-then rule (2.20) can be written as [16]: 


B'® = A' o R® =A’ o (AM => B®), (2.28) 


where A’ = Aj, x A} x --- x Ay is a multidimensional fuzzy set that defines the 
value of the multidimensional input linguistic variable on the space X = X; x X; x 
sii X My, 

The membership function of the conclusion B’ is calculated as follows. 


ugo Y) = sup [ux (x) «7, uro (x, y)] = 


xeX 


sup [ay X1) *r May, (X2) er er Mat, (XN) #7, URO X1, -3 XN Y)], (2-29) 


xeX 


where T, is a t-norm of the supremum-t-norm composition. In the case of the con- 
junctive interpretation (2.15) we can write: 


Hgo (Y) = sup [ux (x) #7, Maw (X) *r, ugo (y)] = 


xeX 


sup | (ux, (x1) *r Ha, (X2) *r <+- xr Man iw) #7, 
xeX 


(ua ED *r map (2) xr +r Hay Cen) #7, Hao O)| (2.30) 
And for logical interpretation (2.16) we get: 


ugo (y) = sup [ux (x) #7, Y (uao (x), ugo (y))] = 


xeX 


sup | (ux, (1) *r Ma, (X2) *r -xr Man (XW) #7, 
xeX 


v (uap Gi) #7 May Ga) ar #r egy Gv), Heo ))]. 3D 


Under certain conditions [5], logical and conjunctive interpretation of fuzzy con- 
ditional rules leads to equivalent inference results. 

Equations (2.30) and (2.31) define the membership function of a fuzzy set repre- 
senting the resulting conclusion of an inference using only one fuzzy if-then rule. For 
a knowledge base consisting of many fuzzy conditional statements it is necessary to 
combine conclusions from all individual rules. 
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2.3.2 Approximate Reasoning with Knowledge Base 


Generally, there are two methods of approximate reasoning that can be applied to 
determine the outcome fuzzy set B’ on the basis of a collection of fuzzy if-then 
rules [4]: 


composition-based inference (first aggregate then infer: FATT), where first a com- 
bination of all rules from the knowledge base is constructed, and then inference 
using the supremum-star composition is conducted, 

individual rule-based inference (first infer then aggregate: FITA), in which the first 
step involves inference using the supremum-star composition for each of the rules 
individually and then, a combination of inference results is performed. 


The FATI process of combining the rules, as well as the stage in the FITA schema 
of determining the resulting conclusion, is called aggregation [10]. The aggregation 
can be defined by introduction of the concept of the aggregation operator [16], which 
for I values x1, x2,..., x, € [0, 1] represents a mapping @ : [0, 1]’ = [0, 1]: 


I 
x = xi = 8 @, x2... x7). (2.32) 
i=l 


There are various definitions of aggregation operator including logical sum, rep- 
resented by an s-norm (Mamdani combination [19]), logical product, represented by 
a t-norm (Gédel combination [16]), as well as nonmonotonic fuzzy operations that 
allow conducting the inference even if part of the knowledge is missing [32]. Most 
of them can be defined as special cases of the generalized average operator [4]: 


1 I : 
1 
Ye On = Wow = hzo i (2.33) 


i=l i=l 


for a € R \ {0}. 
Consequently, the first stage of the FATI method can be defined as: 


T 
R= BR”, (2.34) 
i=1 


where R is the ith fuzzy relation. 
Next, the outcome fuzzy set B’,,,, is determined for an input fuzzy set A’ using 


the GMPP: ; 
Bhar = AN 02 =A' 0 le ro) l (2.35) 
i=1 
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the membership function of which is defined as 


H Brari (y) = sup [ux (x) xT, UB (x, y)] 
xeX 


I 
= wp | (x) *7, le uro (X, » |}. (2.36) 


i=] 


In the case of the FITA method, first the conclusion of each fuzzy if-then rule is 
determined: 


an : B® = A'o R®, (2.37) 


the membership function of which is written as: 


ugo (Y) = sup [ux (X) #7, Hro X, y)]- (2.38) 


xeX 


During the next stage, these partial results of the inference are aggregated forming 
the outcome fuzzy set: 


Bria =e 'o R®) (2.39) 


defined by the membership function: 


I 
Ben, O) = B sup [uw (X) #7, uro (%,y)]. (2.40) 


—1 xeX 


It can be proven [7], that the results of the FATI method are a subset of those 
obtained using the FITA procedure: 


Brari c Brira» (2.41) 


that is: 
Y ug ©)<nugp ©). (2.42) 


yeY FATI FITA 


Usually, for simplicity of calculations, the Bj, 4, is used instead of Bi,;;,, under 
the assumption that the difference is insignificant [4]. 
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2.3.3 Fuzzification and Defuzzification 


In many applications inputs of the fuzzy systems are defined as crisp numerical 
data. However, approximate reasoning requires inputs to be represented as fuzzy 
sets. The process of mapping real values xo = [X01, X02, ---, xon]! EXC RY toan 
N-dimensional fuzzy set A’ defined on X is called fuzzification. The fuzzification 
can be symbolically expressed as a transformation of N-dimensional space into a 
multitude of fuzzy sets [16]: 

X > F(X). (2.43) 


Using membership functions we can write: 
X > {uw (| x € X, wa Œ) € [0, 11}. (2.44) 


Among many definitions of a fuzzification operator, the singleton fuzzifier can be 
distinguished: 
l, X= X0, 


2.45 
0, x #Xo, ( ) 


us X) = Ôx,xo = | 


for which both methods of approximate reasoning (FATI and FITA) provide equiv- 
alent inference results [5]. 

The result of approximate reasoning is a fuzzy set B’ (y), which can be associated 
with a specific linguistic label. However, there are applications that require a crisp 
numerical inference outcome. The process of calculating a representative numerical 
output yo € Y from the outcome fuzzy set B’ (y) on Y is called defuzzification. 
Defuzzification is a mapping of a multitude of fuzzy sets defined on the space Y to 
a single numerical value from Y [16]: 


F (Y) > Y. (2.46) 
Using membership functions we get: 


tug (y)| y € Y, we (y) € [0, 1]} > Y. (2.47) 


Due to the different criteria for determining which element yo of the fuzzy set 
B’ (y) should be regarded as the most representative one, there are many definitions 
of the defuzzification procedure [6, 14, 31]. One of the most popular is a center of 
gravity method (COG), which specifies the result as a center of the area under the 
membership function up (y): 


Jy ue )dy 
Y 


=) ao 2.48 
fue (y) dy ai 
Y 


yo 
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2.4 Basic Types of Fuzzy Systems 


Due to a wide range of possible applications there are many different types of fuzzy 
systems that have been proposed in the literature thus far [4, 16, 22, 23, 31]. But new 
solutions characterized by decreased computation complexity, improved modeling 
quality, or greater ease of the linguistic interpretation of the inference results are still 
the topic of research. The model proposed by E.H. Mamdani and S. Assilan [19] 
is generally regarded as the first fuzzy system presented in the literature. Currently, 
it can be considered as the foundation of the fuzzy models family based on if-then 
rules with fuzzy sets in antecedents as well as consequents. 


2.4.1 Mamdani-Assilan Fuzzy Model 


The Mamdani—Assilan fuzzy system (MAFS) uses a set of conditional fuzzy rules 
in the canonical form (2.20), which can be determined by a human expert. The 
MAFS is based on the conjunctive interpretation of fuzzy rules, where the conjunctive 
“and” of a rule antecedent is defined with the t-norm minimum (A). The inference 
results from individual rules are aggregated by applying the s-norm maximum (v). 
The numerical inputs xp = [x01, x02, - - -, Xoy] are mapped into fuzzy sets with the 
singleton fuzzifier, and the numerical outcome is calculated using the COG method. 
The approximate reasoning schema is realized on the basis of Eq. (2.40), which takes 
the form: 


I 
ug O) =V [nao (0) A ugo O), (2.49) 


i=1 
where 
Ma Xo) = uao or) A hao 02) Av A uao on). (2.50) 


The above equation defines the so-called firing strength of the ith rule, denoted as 
F© (xo). Hence, the formula (2.49) can also be written as 


I 
ue O) = V [F® &0) ^ uso O). (2.51) 
i=l 


Using the COG defuzzification we get: 


Jy we () dy 
Y 


A O 2.52 
fue O)dy Ca 
Y 


Yo 
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Fig. 2.3 Example of fuzzy inference using the Mamdani—Assilan fuzzy system with two inputs 
and the knowledge base consisting of two conditional fuzzy rules 


Figure 2.3 shows an example of fuzzy inference using MAFS with two inputs and 
the knowledge base consisting of two conditional fuzzy rules. 

The defuzzification requires high computational complexity, however, some sim- 
plifications can be applied. Using the algebraic product t-norm and the arithmetic 
mean as the aggregation operator we obtain a Larsen fuzzy system, which is defined 
as [16]: 


I 
1 : 
ba (9) = 5 2d F© (x) uso O). (2.53) 
By substitution of (2.53) into (2.52) we get: 


I . 
> F® (x0) f y ugo O) dy 
yo = = = l (2.54) 
È FO (xo) f ugo O) dy 
Y 
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Denoting the area under a membership function of the fuzzy set B® (y) as 


Anoe I PIA, (2.55) 
Y 


and its center of gravity as y®, we can write: 


i 
> FO (xo) Z (ugo (y)) y® 


i=l 


I 
2 FO (xo) & (ugo (y)) 
J= 


Yo = (2.56) 


The above solution requires only a single calculation of the areas under the mem- 
bership functions and centers of gravity locations for all fuzzy rules. By assuming 
additionally that æ (ugo (y)) are the same for all J consequents, we get the Sugeno- 
Yasukawa fuzzy model [26]. 

Approximate reasoning without the defuzzification necessity was presented in 
papers by Takagi and Sugeno [27] and Sugeno and Kang [25]. The proposed model, 
called the Takagi-Sugeno—Kang fuzzy system (TSKFS), is described in the following 
subsection. 


2.4.2 Takagi-Sugeno—Kang Fuzzy System 


The knowledge base of the TSKFS consists of conditional fuzzy rules with the 
consequents in the form of classical functions, the arguments of which are the input 
numerical data: 


I 


N 
R= {ROY = hir \ (on is LO) , then y = y | : (2.57) 
n=l i=l 
where xon is an input singleton, x9 = [x01, x02, ..-, Xow] , and y (x) is the function 


in the ith consequent. 
The output of each fuzzy rule is a crisp numerical datum y = y" (xo), and the 
TSKES outcome is calculated as a weighted average of individual outputs: 


I P 5: 
> F® (xo) y® (xo) 
i=l 


yo = : (2.58) 
FY (Xo) 


M-~ 


1 


Kane, 
Il 
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where 


F (xo) = pap (X01) *r Map (X02) #7 + xr Ma” Cow) (2.59) 


is the firing strength and xy is a t-norm (usually a minimum or algebraic product). 

Equation (2.58) can be interpreted as a mixture of experts, each modeled by a 
single fuzzy rule. Each rule defines the relationship between outputs and inputs of 
the system in the relevant input range. The weighted average of statements from all 
local experts (rules) determines the reasoning result. The weight, represented by the 
firing strength of the rule, specifies the influence level of a single expert on the final 
inference outcome. 

The consequent of the ith TSKFS fuzzy rule can also be understood as a singleton 
[4], the location of which is determined by the function y® (x): 


a Gates —_ [L y=y® &), 
HUBO (y) = dy, yO = 0, y # y® (xo) , (2.60) 


Hence, the TSKFS is usually referred to as the fuzzy system with “moving” single- 
tons. The term “moving” relates to the relationship between a singleton location and 
the input numerical data. The amplitude (height) of the singleton after the approxi- 
mate reasoning is defined by the firing strength of a rule. 

The TSKFS consequents are frequently defined as linear functions (first-order 
polynomials): 

© _ pi) 1 pf) Q) a pOy — nOTy 
y“ &%o) = po + pi X01 + Py Xo + +++ + py Xon =P Xo, (2.61) 

where p® is the (N + 1)-dimensional vector of parameters of the function y® (x), 
and xj denotes the extended input vector: 


x =[1 x0]. (2.62) 


A collection of simple linear functions y“ (x) allows for modeling the most 
complex input-output relationships. Overlapping areas of antecedents in neighboring 
rules ensure smooth switching between the local models. 

An example of TSKFS inference with two inputs and two conditional fuzzy rules 
is shown in Fig. 2.4. The main advantage of the TSKFS is the low computational effort 
required to determine the numerical output of the system as the inference process 
does not involve defuzzification. However, it does not allow for the application of 
different interpretations of the fuzzy rules and different types of aggregation opera- 
tors. This is due to the application of singletons in the rules consequents. The artificial 
neural network based fuzzy inference system (ANNBFIS) [17] is devoid of such 
disadvantages. The ANNBFIS combines the benefits of the usage of a fuzzy set in 
the rule consequent (as in the MAFS) together with the dependency of the consequent 
location on system inputs (as in the TSKFS) [4, 15, 16]. Another extension of the 
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Fig. 2.4 An example of approximate reasoning with Takagi-Sugeno—Kang fuzzy system with two 
inputs and two fuzzy if-then rules 


TSKFS is the Tsukamoto fuzzy system (TFS) [28]. The main difference between 
TSKEFS and TFS is the method of determining the singleton location in the consequent 
of the fuzzy rule. In TFS it is defined using a monotonic function as well as a firing 
strength of the rule. 


2.4.3 Tsukamoto Fuzzy System 


The knowledge base of TFS is a collection of fuzzy conditional statements in the 
form: 


N 
RÖ =it N (xon is i) , then y =f! (F (xo) , (2.63) 


n=1 


where f; (y) is a monotonic function in the ith consequent. 
For the firing strength equal to F® (xo) the consequent is a singleton with the 
amplitude F (xo) and the location y such that F (xo) = fi (y): 
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z F© (xo) = yO 
; — FÖ eae O,yvy=Hy; 
HUBO (y) = FY (Xo) by yo = te y z y®, 


(2.64) 
where y? = f7! (F (xo)). 

The inference outcome of the TFS is calculated as a weighted average of singleton 
locations from all rules, with weights defined as the rules firing strengths: 


> FO (xo) y® > F (xo) f ' (F© &%)) 
y = Z == 7 ee) 
> FO (xo) È FY Xo) 


S 
ll 
= 
S 
ll 
= 


An example of the Tsukamoto approximate reasoning with two inputs and two 
fuzzy if-then rules is shown in Fig. 2.5. 

The TFS is rarely used due to the difficulty in obtaining the conditional fuzzy 
rules from a human expert in the form (2.63). For the same reasons the Baldwin 
fuzzy system (BFS) [1, 2] is difficult to apply in practice. The BFS represents a 
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Fig. 2.5 Example of the Tsukamoto approximate reasoning with two inputs and two fuzzy if-then 
rules 
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different approach to fuzzy modeling, which is not based on Zadeh’s compositional 
rule of inference but on reasoning using fuzzy truth value restrictions. The literature 
describes many other interesting proposals of fuzzy models, including those based on 
interval-valued fuzzy sets and type-2 fuzzy sets. A detailed overview can be found, 
for example, in [13, 18, 29, 30]. 


2.5 Summary 


In this chapter we discussed basic problems related to the idea of fuzzy systems 
based on the Zadeh compositional rule of inference. The presentation started with 
explaining the concepts of the linguistic variable and fuzzy conditional statement. 
Next, different types of the fuzzy if-then rules and various methods of their mathe- 
matical representation were presented. Also, an overview of the compositional rule 
of inference proposed by Zadeh was introduced. General theoretical considerations 
on approximate reasoning were supplemented with examples of elementary fuzzy 
models. We described the basic solutions being the foundation of many modern con- 
structions including fuzzy systems of Mamdani—Assilan, Takagi-Sugeno—Kang, and 
Tsukamoto. 


Acknowledgements This work was supported by the Ministry of Science and Higher Education 
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Part II 
Theory of Ordered Fuzzy Numbers 


Chapter 3 
Ordered Fuzzy Numbers: Sources 
and Intuitions 


Piotr Prokopowicz and Dominik Slezak 


Abstract Most emerging methodologies, before they become well settled, stem 
from careful analysis of previous solutions. In that respect, this chapter refers to the 
roots of the Ordered Fuzzy Number (OFN) model. First, we outline some drawbacks 
of the most popular fuzzy number representations, which inspired us to search for 
a new approach. Then we discuss the idea of looking at fuzzy numbers from an 
alternative viewpoint. This leads towards formulation of the OFN model comprising 
three conceptual steps: (1) representing membership functions of fuzzy numbers 
as the pairs of increasing/decreasing components; (2) for each of two components 
treated as a locally defined function, inverting the meanings of its domain and its set 
of values; and finally (3) treating the obtained pairs of components as the ordered 
pairs. By introducing arithmetic operations on such ordered pairs, we obtain the 
framework, which is in many cases equivalent to the previous approaches but it also 
enables the representation of new information aspects. 


3.1 Introduction 


The Ordered Fuzzy Number (OFN) model was defined as a result of searching for 
simple and flexible algorithms performing calculations on fuzzy numbers [10]. A 
more formal description of the OFN model is provided in Chap. 1. Here we focus on 
initial inspirations, which can be helpful to understand the meaning behind mathemat- 
ical formulas for OFN operations. Indeed, if someone with a thorough background 
in the theory of fuzzy sets jumps immediately to Sect. 3.5, the first impression might 
be confusing. Thus we encourage the readers to study the contents of this chapter 
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step by step, in order to realize that the considered model developed primarily by 
Witold Kosiński is truly straightforward and easy to handle. 

The chapter is organized as follows. In Sect.3.2, some potential drawbacks 
of classically defined fuzzy numbers are explained. In Sect.3.3, some alternative 
proposals regarding how to deal with those drawbacks are outlined. In Sect. 3.4, 
we discuss an idea of decomposing the shapes of fuzzy numbers onto ascend- 
ing/constant/descending components, that is, expressing fuzzy membership func- 
tions in so-called quasi-invertible form that was utilized to redefine fuzzy numbers 
in [11]. In Sect. 3.5, we discuss how the idea of operating with quasi-invertible func- 
tions led us towards the OFN model. Section 3.6 concludes the chapter. 


3.2 Problems with Calculations on Fuzzy Numbers 


Basic operations on standard fuzzy numbers were discussed in Chap. 1. Two popular 
mechanisms of introducing them were mentioned: via the extension principle [3] and 
via interval calculations on a@-cuts [1]. In both cases, for both addition and subtraction 
operations, their outcomes support increases compared to their inputs. Thus, their 
fuzziness increases. After performing several calculation steps, a resulting number’s 
support usually becomes extremely broad, whereby information represented by that 
number is no longer practically useful. 

In [12], we can find a more general summary of problems with original approaches 
to fuzzy arithmetics. Certainly, those problems can be handled using some more 
advanced models, thus propagation of fuzziness becomes more tractable during com- 
putations [21]. It should also be noted that standard fuzzy arithmetic methods turned 
out to be very useful in a number of practical applications [7]. Nevertheless, in some 
cases, one may require more straightforward tools for limiting or — sometimes — even 
reversing a degree of imprecision represented by fuzzy numbers. This observation 
inspired us to search for a new way of representing and computing fuzzy numbers. 
Two major goals in front of us were: 


1. To introduce an intuitive model enabling us to decrease (not only increase) impre- 
cision/inaccuracy as a result of arithmetic operations 

2. In addition, to introduce such mechanisms of fuzzy number calculations that 
would be easy to understand and implement in practice 


The general concept that allowed us to control imprecision during calculations can 
be interpreted as a kind of direction of fuzziness [18]. Chapter 4 contains a complete 
description of that idea from a mathematical perspective. It shows how the considered 
OFN model allows us to think about canceling fuzziness while adding/subtracting 
opposite or reversed fuzzy numbers. The remainder of this chapter can be treated as 
introductory background for that formalism. 
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3.3 Related Work 


Let us present a short preview of other existing approaches to deal with the problem 
of increasing imprecision during fuzzy calculations. Generally, we can categorize 
such approaches as those refining standard operations [21], those introducing new 
operations [19], and those specifying a kind of context of operations [8]. 

In [19], two additional operations on fuzzy numbers were introduced: nonstandard 
subtraction and nonstandard division. Those operations are quite complicated but 
indeed it is true that, for fuzzy numbers A, B, C, equation A + B = C is equivalent 
to equation C © B = A, where © denotes nonstandard subtraction. In our research, 
we kept looking for another solution, as it is not always a good idea to introduce new 
operations. It may be problematic from both conceptual and technical perspectives. 
In the space of real numbers, subtraction is equivalent to addition of an opposite 
number. By analogy, there should be no need to define a separate subtraction operation 
for fuzzy numbers. The same reasoning can be carried out for multiplication and 
division. This can be represented by requirements of a form A — B = A+ (—B) 
and A/B = A- B™!, which are not addressed in [19]. 

In [8], Klir presented another approach to operations on fuzzy numbers (by means 
of fuzzy intervals). His idea takes into account a context of relationship between two 
numbers — referred to as a requisite constraint — which may optionally allow a 
decrease of fuzziness in calculations. It is effective in solving equations of a type 
A + X = B, if we know that X = B — A. However, just as above, this method may 
make calculations complicated. The assumption that we are able to set up requisite 
constraints for all relevant pairs of quantities for a given calculation is difficult to 
track for more complex scenarios. Still, the ideas proposed in [8] seem to be closer to 
our way of understanding operations on fuzzy numbers than those in the case of [19]. 
However, in the OFN model, additional information, a kind of context, is assigned 
to particular numbers rather than relationships between them. 

The above ideas became a source of our inspiration in 2000-2003, when the OFN 
model was formulated. However, the problem of expanding fuzziness is also present 
in more recent research. For instance, Dymova et al. proposed the operation called 
interval extended zero [6]. It is used to solve linear fuzzy equations. As another 
example, Piegat and Landowski utilized RDM (relative distance measure) interval 
arithmetics [15]. Furthermore, Stupnanova combined fuzzy operations with prob- 
abilistic modeling [20]. Such methods should be compared to the OFN model in 
a more detailed way. However, we should remember that all of them aim at better 
controlling rather than eliminating/reversing fuzziness during calculations. 


3.4 Decomposition of Fuzzy Memberships 


The remaining sections include some basic observations and suggestions on how to 
change standard representation and meaning of fuzzy numbers. We start by recalling 
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the original concept of a fuzzy set [22]. Then we concentrate on the nature of shapes 
of standard fuzzy numbers. Finally, we introduce a new representation based on the 
already-mentioned inversion of the roles between the domains and the sets of values 
for particular components of those shapes. 

As we know, a fuzzy set A over a space X is defined as a set of pairs, namely A = 
{(x, ua (x)) : x € X}, where u4 : X — [0, 1] denotes a fuzzy membership function 
that assigns to each element x € X its degree of membership to A. In Sect.3.5, we 
refer to a more general understanding of fuzzy sets. However, for now let us follow 
the above formulation and consider a fuzzy number as a fuzzy set over the space of 
real numbers R!: 

A= {(x, waQ)) : x € R} (3.1) 


As pointed out in Chap. 1, each fuzzy number A is supposed to be a normal fuzzy 
set; that is, there exists x € R such that w(x) = 1. Moreover, its support should 
be bounded: that is, there exists interval (s4, e4) such that w4(x) >0, if and only if 
x € (sa, ea). Finally, A is supposed to be a convex fuzzy set and its membership 
function should be piecewise continuous. 

The convexity of A corresponds to the strict quasi-concavity of function u4 or, 
equivalently, the strict quasi-convexity of function — u4 [4]. Detailed properties of 
strict quasi-convexity can be found, for example, in [13]. Saying that function — u 4 
is strictly quasi-convex (and u4 is strictly quasi-concave) means: 


Yy yzeR X < y <z A^ ualx) F MaA(Z)) > (uay) > min(ualx), na(z))) (3.2) 


Figure3.1 illustrates a difference between functions that are convex/concave and 
strictly quasi-convex/quasi-concave. 

According to one of the theorems proved in [13], the fuzzy membership func- 
tion u4 is strictly quasi-concave within a convex set X, if and only if any segment 
(x1, x2] C X can be divided into three sections such that u 4 is increasing in the first, 
constant in the second, and decreasing in the third section. Moreover, any one or 
two of these sections may be empty or degenerated to a single point. Thus, one can 
conclude that for a given fuzzy number A we have values 1}, 1$ € (s4, €a) such that 
ua has an increasing part defined over (s4, 14) and a decreasing part over ai ea). 
There is also a constant part equal to 1 over the interval (or a single point) [14, 14]. 

The above kind of piecewise representation goes well together with some other 
approaches to model fuzzy arithmetics, for example, by means of so-called L-R num- 
bers [5]. For more details on this methodology, let us refer to [2], where L-R numbers 
are thoroughly compared to the OFN model. From our perspective, it is especially 
interesting that both increasing and decreasing parts of strictly quasi-concave fuzzy 


lIn the literature, fuzzy numbers are often denoted by A. However, as in our case it does not lead 


to any misunderstanding, we simply use notation A. 


254 and e4 can be intuitively regarded as a start and end of A. Analogous notation is used in 


Chap. 4, along with 14 and If. However, inequalities s4 < 14 < it < ea that hold for standard 
fuzzy numbers will not need to be true in the OFN model. 
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Fig. 3.1 Examples of functions that are strictly quasi-convex but not convex (left) and strictly 
quasi-concave but not concave (right) 


membership functions are invertible. Such characteristics are hereinafter referred to 
as quasi-invertibility. This enables us to define operations on inverted parts of fuzzy 
numbers’ membership functions. 


1. Inverted increasing parts of u4 and upg are added to each other. 

2. Inverted decreasing parts of u4 and upg are added to each other. 

3. After reinverting both obtained sums, we obtain a function that is treated as 
membership uc of fuzzy number C = A + B (see Fig. 3.2). 


The above mechanism was studied in the literature as an alternative way of thinking 
about fuzzy arithmetics [11]. Although conceptually it does not change the standard 
model, it turns out to be very simple to implement in practice. It is also the best 
starting point for explaining the OFN model. 


3.5 Idea of Ordered Fuzzy Numbers 


The quasi-invertibility-based addition procedure recalled in Sect. 3.4 could be alter- 
natively rewritten by representing fuzzy numbers A and B as unordered pairs of piece- 
wise continuous monotonic functions f4, ga : [0,1] > Rand fg, gz : [0,1] > R. 
In the first step, we would then need to check which of those functions are increas- 
ing/decreasing in order to obtain a valid result. However, it would not yet solve the 
issue of propagation of imprecision in computations, which was one of our main 
motivations while searching for a new model of fuzzy arithmetics. 

Let us go back for a while to the discussion in Sect. 3.3. Let us note that one of 
the requirements to limit imprecision corresponds to a need of introducing opposite 
fuzzy numbers, that is, for each A, defining fuzzy number — A such that A + (—A) = 
A — A =0, where 0 denotes the fuzzy number representation of crisp 0. 
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Fig. 3.2 Example of adding standard fuzzy numbers using quasi-invertibility 
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Fig. 3.3 Example of adding two OFNs. The result is comparable to that obtained in Fig. 3.2 
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As expressing opposite numbers is hardly possible in standard fuzzy arithmetics, 
let us consider a slightly revised notion of fuzzy number. The following definition 
includes an imposed order between components representing fuzzy numbers. This 
order may be regarded as an additional aspect of information — a kind of fuzzy 
number’s context — which is independent of the values of fuzzy memberships. Let us 
also note that fuzzy number components are now defined in an inverted way when 
compared to standard fuzzy numbers. 
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Fig. 3.4 Example of adding two OFNs, where B has a reversed order compared to Fig. 3.3 
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Definition 1 (Ordered Fuzzy Number) A = (fa, ga) is an ordered pair of contin- 
uous functions f4, ga : [0,1] — R, called the up part, and the down part of A, 
respectively.’ 


The shape related to the pair (f4, ga) is not different from the case of (g4, fa). 
However, these are two different OFNs (unless fa = g4). They differ by something 
that can be interpreted as direction, in some papers also called orientation. Actually, 
interpretation related to direction inspired some researchers to propose renaming 
the presented model as directed fuzzy numbers or fuzzy numbers with direction. 
Moreover, in papers [16—18], the name Kosiriski’s Fuzzy Numbers is used to honor the 
contribution of Witold Kosiński in a development of the considered model. Although 
in this book we keep the original OFN terminology, we believe that the discussion 
about the most appropriate name is not over. 

Let us notice that it is now possible to define A’s opposite as —A = (f_4, g_a), 
where f_4 = — fa and g_, = —g,. In a standard model, while adding such numbers 
represented as unordered pairs f4, ga : [0,1] —> R and f-4, g_a: [0, 1] > R, we 
would need to combine f4 with g—4 and g4 with f_4. However, in the OFN model 
— as formally introduced in Chap. 4 — we follow the ordering of component functions 
rather than their increasing/decreasing characteristics. Figures 3.3 and 3.4 illustrate 
more examples. We can see that the ordering of components defining a fuzzy number 


3Notation A = (f4, ga) reflects the original way of referring to the up and down parts introduced 
in [10]. Surely, one could also think about a more intuitive naming, for example, f4 and | 4 instead 
of fa and g4, respectively. One could also think about denoting OFNs in a different way, such as 
using sign ~> above A (by analogy to A; see the footnote in Sect.3.5). Nevertheless, by writing 
A = (fa, 8A) we wish to keep consistency with the previous materials. 
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can have a huge influence on results, including the opportunity to reverse fuzziness, 
that is, to have outputs that are crisper than inputs. 

In our previous works, we paid special attention to direction-related interpretation 
of OFNs, that is, the above-mentioned new aspect of information that enables us to 
distinguish between pairs (f4, ga) and (g4, fa). One possibility is to refer here 
to a trend of fuzzy observation or measurement [9]. Indeed, decomposition of a 
fuzzy number’s membership function onto two ordered components establishes an 
interesting background for representation of a trend by means of the up part, which 
is a natural beginning, and the down part, which is a natural end of observation. 
For example, by reversing the ordering of the OFN’s components one might specify 
whether a given observed imprecise value is generally likely to increase or decrease. 
Surely, one could claim that such information is expressible also in classical fuzzy 
logic by adding new trend-related linguistic variables. However, that would result 
in a more complex fuzzy-rule-based representation, leading towards a less intuitive 
framework for conducting arithmetic calculations on measurements. 

We refer to Chap. 4 for further details on possible interpretations of information 
represented by the OFN model. For now, let us add that by introducing an order 
of components (f4, ga) and, this way, letting A’s up and down parts be potentially 
both increasing and decreasing, we enter a far richer space of outcomes of arithmetic 
calculations. In Chap.4 we show that operations on such ordered pairs may lead 
towards results that are not interpretable as standard fuzzy numbers, as some elements 
of R correspond to multiple memberships. One could think of it as a special case 
of some extensions of fuzzy set theory [14]. One could also refer to original ideas 
of Lotfi A. Zadeh who, in his paper [22], stated that “The concept in question is 
that of fuzzy set, that is a ‘class’ with a continuum of grades of membership.” Thus, 
the OFN model could be interpreted as a new way of assigning real numbers with 
the continuum of grades of membership. Certainly, further theoretical studies in this 
respect are necessary as well. 


3.6 Summary 


In this chapter, we recalled the roots of the Ordered Fuzzy Number (OFN) model 
[10]. We outlined disadvantages of standard fuzzy arithmetics and discussed how 
to look at fuzzy numbers in an alternative way, by representing them as ordered 
pairs of functions that encode the shapes of fuzzy memberships. In this way, we 
obtained a mathematical framework that extends the standard approach including a 
new type of information referred to as a direction of a fuzzy number [18]. We showed 
a kind of evolution of our way of thinking about fuzzy arithmetics, starting from the 
classical approach, via quasi-invertible representation of convex fuzzy numbers, and 
finishing with formal definition of OFNs. We also discussed how the obtained model 
lets us better manage degrees of imprecision during calculations and how one could 
interpret fuzzy numbers’ direction. 
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Chapter 4 
Ordered Fuzzy Numbers: Definitions 
and Operations 


Piotr Prokopowicz and Dominik Slezak 


Abstract We outline basic notions and assumptions related to the Ordered Fuzzy 
Number (OFN) model. Definitions of mathematical operations, several interpreta- 
tions of their results, as well as additional OFN parameters are presented. Some of 
them, such as inclination or order, are specific to OFNs, whereas others are equiva- 
lent to those present in the well-known convex fuzzy number model. An important 
aspect of this part is also a discussion of algebraic properties of the OFN model. 


4.1 Introduction 


In previous works, we noted that original fuzzy arithmetic operations could have 
some limitations. Those limitations were recognized and addressed in different ways 
[17, 25]. Many researchers agree that calculations involving fuzzy numbers should 
accumulate uncertainty, by compliance with the meaning of a fuzzy number as a 
distribution of possibilities [26, 27]. Indeed, this assumption occurs in almost all 
interpretations of fuzziness [4, 5]. Although it seems to be natural for many appli- 
cations, we would like to point out that in some scenarios it would be truly useful 
to derive crisper information from fuzzier inputs, that is, to reverse the uncertainty 
accumulation process. We believe that by allowing such reversing one would obtain 
a kind of general mathematical model of fuzzy numbers, which — depending on 
practical needs — can possess more or less constrained properties. 

Following the above way of thinking, we have been seeking a framework that 
would include standard fuzzy numbers as special cases. One of the possibilities for 
building such a broader space of fuzzy numbers is to rely on the Ordered Fuzzy 
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Number (OFN) model [13, 15], that is, proceed with decomposition of membership 
functions of fuzzy numbers onto ordered components. By treating those components 
as an ordered pair, it becomes possible to model the fuzzy number opposites better, 
canceling each other out instead of growing their fuzziness. In this chapter, we look at 
such capabilities of OFNs from a mathematical perspective and discuss basic proper- 
ties and examples of OFN arithmetic operations in order to illustrate computational 
straightforwardness and representative richness of the considered approach. We also 
pay attention to the role of those objects in the space of OFNs that do not correspond 
to fuzzy numbers understood as standard fuzzy sets. 

The chapter is organized as follows. In Sect. 4.2, we recall preliminary concepts 
of the OFN model. In Sect.4.3, we discuss how to redefine fundamental notions 
of fuzzy sets and numbers for OFNs. In Sect.4.4, we focus on OFNs that are not 
expressible by means of standard fuzzy numbers and, in particular, we show how 
to transform them into a convex fuzzy set format. In Sect.4.5, we outline basic 
arithmetic operations and discuss the corresponding algebraic properties of the OFN 
model. In Sect. 4.6, we discuss the notion of the OFN’s direction from the perspective 
of practical applications. Section 4.7 concludes this part. 


4.2 The Ordered Fuzzy Number Model 


As already recalled in Chap. 3, the considered idea of an alternative way of looking 
at fuzzy arithmetics is based on the notion: 


Definition 4.1 An Ordered Fuzzy Number (OFN) A is an ordered pair 


A= (fa, 8a) (4.1) 


of continuous functions f4, g4 : [0, |] > R, called the up part, and the down part 
of A, respectively. 


It follows from the continuity of f4 and g4 that their images are bounded intervals. 
Let us denote them as U P4 = fa([0, 1]) and DOWN, = g4([0, 1]) (see Fig. 4.1). 

Considering functions f4 and gy as an ordered pair is the crucial difference in 
comparing to standard fuzzy numbers that can be represented by means of so-called 
L-R notation [4]. By L and R one means left (increasing) and right (decreasing) 
components of amembership function of a given fuzzy number. Such components can 
be inverted to form functions assigning real values to the elements of the unit interval 
[0, 1] [16]. Standard arithmetic operations on such represented fuzzy numbers are 
then defined over the pairs of increasing components and the pairs of decreasing 
components. This means that in the classical framework it is impossible to add, for 
example, an increasing component of a fuzzy number A to a decreasing component 
of another fuzzy number B. In the case of OFNs, such operations are allowed. 

As discussed in Chap. 3, shapes related to pairs (fa, ga) and (ga, fa) are the 
same. However, they differ by something that can be interpreted as direction. This 
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Fig. 4.1 An example of 
OFN 


DOWN 


UP 


new kind of information can be additionally marked graphically with arrows. It can 
be seen in Fig. 4.2, which illustrates the following operation. 


Definition 4.2 Reversal of direction of A = (f4, ga) consists in replacing its up 
part (fa) and down part (g4) with each other. The resulting OFN A|~ = (faj-. gaj-) 
is defined as follows, for each a € [0, 1], 


fa- (œ) = ga(@) — gaj-(@) = fala) (4.2) 


A|~ is called an OFN of reversed direction or a reversed OFN. 


To distinguish between different types of OFN directions, let us also introduce the 
following characteristics. Herein, parameters są = [4 (0), ea = ga (0) (s / e stands 
for start/end) and 1, = f,4(1), 1$ = ga (1) (— / + stands for reaching/leaving a 
precise component of a fuzzy number) are useful. 


Definition 4.3 For a given A = (fa, ga), we Say that: 


e Direction is strictly neutral, if fa = ga; that is, each element belongs equally to 
the up and down parts of A. 
e Direction is strictly positive for fa A ga,ifl, < 14, elseif l} = 1) ands, < eg. 


e Direction is strictly negative for fa A ga,ifl, > 14, elseifl, = 1, ands, > e4. 


The above rules define some specific cases of strict direction. Certainly, one can 
notice that the reversal operation changes directions; that is, if A is strictly positive 
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Fig. 4.2 Reversal operation A 


- Badr 


> 


(negative), then A|~ is strictly negative (positive). However, one can also imagine 
pairs (fa, ga) that do not follow any such neutral/positive/negative characteristics. 
For example, one can consider a situation where fa Æ ga and at the same time there 
is są = 1, = 1} = e4. Although such pairs do not possess a strict direction, they 
can play an important role in fuzzy arithmetic operations. 

Another notion that was introduced within the OFN model is inclination. Its 
role is to make a general comparison between the up and down parts of a given 
A = (fa, ga). Below let us refer to the so-called mean inclination: 


Definition 4.4 The mean inclination of an OFN A = (f4, ga) is defined as the 
function ima : [0,1] > R: 
ima = (fa + ga)/2 (4.3) 


Let us note that the mean inclination of OFNs with symmetrical shapes is a con- 
stant function. It does not depend on direction, in particular, there is ima = imal-- 
Inclination can be used, for example, in a defuzzification process. For more detailed 
investigation related to defuzzification methods in the OFN model, refer to [2, 10] 
and some further chapters in this book. Below we recall just one example. 


Definition 4.5 Let OFN A = (fa, ga) be given. The result of the center of mean 
inclination defuzzification is the real number x, calculated as follows. 


Xa = (Xmin F Xmax)/2 (4.4) 
where 


Xmin = min{in 4 (œ) [WE [0, 1}} Xmax = max {in (œ) Q E [0, 1}} (4.5) 


4.3 Basic Notions for OFNs 


There is a huge variety of pairs (fA, gą), wherein only a part of them is going 
to correspond to standard fuzzy numbers, whereas the others may require deeper 
interpretation. From the point of view of arithmetic operations, those other numbers — 
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called improper OFNs (see Sect. 4.4) — can be treated as abstract objects aimed at 
transforming standard inputs into standard outputs. Thus, it is important to understand 
the general characteristics of both proper and improper OFNs. 


4.3.1 Standard Representation of OF Ns 


One of the most basic special cases refers to OFNs A = (f4, ga) with monotonic 
functions. If f4 and g4 are both monotonic, then intervals U P4 and DOWN, retain 
the following dependencies. 


UP, =[min{s4, 14}, max{s4, 1;}] DOWN, =[min{1}, e4}, max{14, ea} ] 
(4.6) 
Furthermore, for monotonic f4 and ga, it is possible to determine their inverse 
functions from R to [0, 1]. Inverse functions are defined in a nontrivial way within 
the corresponding intervals UP, and DOW N4. To obtain a kind of continuous 
shape, we connect them with a plot of a constant function equal to | over interval 
CONST, = [min{1,, eae max{l,, 14H (Fig. 4.3). Thus we have three functions 
that can be used to represent monotonic pairs (f4, g4) in a form more comparable 
to standard convex fuzzy numbers recalled in Chap. 1. 
This form (or a view) is called a standard representation. The three considered 


functions ae ws aed are defined as follows, for x € R: 
-1 
UP; fa (x) forx € UP, 
1a es | 0 otherwise 
1 for x e CONST. 
CONST (,) _ A 
Na a | 0 otherwise CD 


DOWN (x) = ga œ) for x € DOWN, 
TA ~ 10 otherwise 


f” 


UP Added interval DOWN 


Fig. 4.3 OFN presented in the standard form corresponding to convex fuzzy numbers 


62 P. Prokopowicz and D. Slezak 


The above functions can be called the up part, the constant part, and the down part. 
A fuzzy number represented in such a way can be interpreted analogously to the 
standard model of convex fuzzy numbers, as outlined in Chap. 1. Properties of the 
U P, and DOWN, intervals (equalities 4.6) can be rewritten as 


nYa = aDSL a" ape ale =0 (4.8) 


Similar transformation might also be possible for nonmonotonic up/down parts, 
although in such a case we would need to proceed with inversion of curves rather 
than functions. This would surely lead us towards the already-mentioned improper 
OFN objects. We also need to remember that even pairs of monotonic functions can 
correspond to improper OFNs. For example, if fa and g4 are both increasing or both 
decreasing, then the above-considered three-component representation of A is still 
straightforward although it does not correspond to a standard fuzzy number. 


4.3.2 OFN Support 


Let us extend the concept of support — one of the most fundamental fuzzy set notions — 
onto the realm of OFNs. The extension is presented for both a general case and for 
OFNs A = (fa, ga) with monotonic functions f4 and g4. This way, just as before, 
the monotonicity of components is used as an illustrative special case, for which it 
is easier to interpret basic concepts inherited from fuzzy set theory. 

A support is an important parameter in analyzing and modeling convex fuzzy 
numbers. In many practical situations, calculations involving fuzzy numbers are 
actually focused on their ranges of maximum membership and nonzero membership, 
which correspond to their supports. It is therefore also useful to introduce this notion 
for the OFN model. The following definition extends the classical case: 


Definition 4.6 For OFN A = (f4, ga), the support supp, is an interval calculated 
as follows. 


suppa = {fa(a): a € (0, 1]} U CONST, U {g4(a): a € (0, 1)} (4.9) 


Let us note that supp, is almost equal to the set-theoretic sum of intervals U P4, 
CONST,, and DOW N4. The only difference is that — depending on the shapes of 
functions f4 and g4 — we sometimes need to subtract elements s4 and/or e4. 

Going further, if we consider OFNs with monotonic up and down parts, the sup- 
port can be equivalently introduced by a simpler formula. Namely, we can use the 
bounds of particular intervals U P4, CONST,, DOWN, of an OFN A = (fa, ga) 
to determine its support supp a: 
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(x1, x2) for xı € CONST, and x2 € CONST, 


[x1, x2) for xı E CONST, and x2 € CONST, (4.10) 
SU = a 
PPA = V Cxi, x9] for xı € CONST, and x2 € CONST, 


[x1, x2] for xı E€ CONST, and x2 € CONST, 


where 
x; = min{s,, ea, lgs leg x2 = max{s,4, ea, l4, 14} (4.11) 


Certainly this is just one of the possibilities to generalize the standard notion of a sup- 
port onto the case of OFNs. Depending on interpretation, one might also think about 
defining supp, as an ordered interval [8] or as an interval (ordered or nonordered) 
taking into account only the quantities of są and e4. Nevertheless, any reformula- 
tion of support should be equivalent to standard support whenever an OFN can be 
interpreted as a standard convex fuzzy number. 


4.3.3. OFN Membership Function 


Let us attempt to redefine the notion of a fuzzy membership function for OFNs in 
general. The following way of doing it is, as in the case of support, one of many 
possibilities. In principle, we propose that a fuzzy membership of a number x € R in 
an OFN A = (fa, ga) should be the highest context a € [0, 1], in which x occurs, 
that is, such that f4 (œ) = x or g4 (œ) = x. 


Definition 4.7 A membership function of OFN A = (f4, ga), denoted by ma : 
R — [0, 1], is defined for x € R as 


1 for x e CONST, 
ba(x) = 0 for x ¢ suppa 
max{a € [0, 1]: fa(a) = x V ga(a) = x} otherwise 
(4.12) 
If the up and down parts correspond to monotonic functions, then we can redefine 
the membership function of an OFN as below: 


1 for x € [min{1j, 14}, max{1), 14} 
a(x) = 0 for x ¢ suppa (4.13) 
max{ f, | (x), a (x)} otherwise 


The above form remains consistent with Definition 4.7, however, it starts resem- 
bling standard membership functions. If fa and g4 have disjoint images, then 
max{ fa Œ), g o} can be replaced by F œ and g (x) within intervals 
UP, \ Uy ed and DOWN, \[1,, ea 8 respectively. Moreover, if the up part is 
increasing, the down part is decreasing, and f4 < ga, then a formula in Definition 
4.7 becomes the exact representation of a standard fuzzy number’s shape. 
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The formula in Definition 4.7 possesses very interesting characteristics also for 
improper OFNs A = (f4, ga), regardless of whether their corresponding functions 
fa and g4 are monotonic. Namely, for an arbitrary OFN, its membership function 
can be decomposed onto three fragments: strictly increasing, constant, and strictly 
decreasing. Some of those fragments may not correspond to continuous functions 
but the resulting membership function remains piecewise continuous as expected for 
standard fuzzy numbers. The mechanism introduced in Definition 4.7 is sometimes 
referred to as the so-called MAX-choice principle (see Sect. 4.4). 

Thanks to the above observation, OFN membership functions can be employed in 
practice similarly to those of convex fuzzy numbers. As elaborated in Chap. 2, fuzzy 
memberships play the role of important numeric counterparts of linguistic rules in 
control systems. On the other hand, in further chapters we show that sometimes it is 
worth mixing classical approaches to constructing fuzzy controllers with those based 
on fuzzy arithmetics. From this perspective, generalizations of fuzzy membership 
functions for the OFN model can be especially helpful. 


4.3.4 Real Numbers as OFN Singletons 


In the case of convex fuzzy numbers, a real number x € R is represented by the 
characteristic function Xxx, which equals 1 for x and 0 otherwise. In the OFN model, 
representing real numbers is easy and intuitive as well. 


Definition 4.8 A real number x € R is represented in terms of OFNs by a pair 
X = (fx, 8x), Where fx and gx are defined as the function constantly equal to x: 


R= f=* (4.14) 


Thus, an OFN representing real number x forms a unit at the level x. After transform- 
ing it to a standard view it is a vertical segment. It also coincides with the meaning 
of singleton in the case of standard fuzzy numbers. Therefore, the name singleton is 
used for real numbers represented in the OFN model as well. 

The support of a singleton according to Definition 4.6 is the interval [x, x], 
that is, a single point x. Such a singleton always has strict neutral direction 
(see Definition 4.3). This is because the whole OFN is covered by both its parts, 
up and down. 


4.4 Improper OFNs 


The OFN model suggests looking at imprecision from a new perspective. The key 
aspect is related to the notion of direction. It can be interpreted in a practical way. 
Some examples of interpretations of that new aspect can be found in Sect. 4.6. OFNs 
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1 2 3 4 5 6 7 8 9 10 


Fig. 4.4 Examples of improper OFNs 


are considered there as results of observations in time. Indeed, the time can be a 
natural (although not the only) interpretation of direction. 

The consequence of the new approach to modeling imprecise numbers is a kind 
of inconsistency with standard fuzzy numbers. Namely, there are OFNs, which do 
not have a membership function in the sense of a convex fuzzy set. We have already 
mentioned such improper OFNs several times. A subspace of improper OFNs can 
be characterized in many ways. Let us formalize them as 


Definition 4.9 We say that A = (f4, g4) is an improper OFN, if: 


1. fa or ga is not monotonic. ! 


2. UPa, DOWNag, and/or CONST, overlap.? 


In general, when one of the parts of an OFN is neither monotonic nor constant, then 
such an OFN is improper. However, as already mentioned, there exist also improper 
OFNs with monotonic parts. For some examples, let us refer to Fig. 4.4. Let us note 
that, as earlier, we use arrows to express graphically OFNs’ direction. 

Improper OFNs cannot be represented as convex fuzzy sets. Still, it does not mean 
that they are of no use. When we interpret the direction as time of a measurement, 
then even improper OFNs turn out to represent important information about the 
observed processes (see Sect. 4.6.3). Moreover, it may turn out that during a chain 
of arithmetic calculations some intermediate results are improper, even though both 
inputs and outputs are interpretable as standard fuzzy numbers. In such cases, it 
would be quite unreasonable to abandon the whole computational process because, 
after all, the most important aspect is the interpretation of the final results. 

If for a given scenario interpretation of an improper OFN is important, we can — 
depending on practical needs — utilize one of the available defuzzification mecha- 
nisms (e.g., the one outlined at the end of Sect. 4.2) or proceed with fuzzy member- 
ship derivation described in Definition 4.7. As mentioned before, we can refer to that 


lFor simplicity, in this chapter we do not distinguish between the cases of increasing/decreasing 
and nondecreasing/nonincreasing functions. In this definition, we refer to that second case. 

?By overlapping of intervals, for example, U P4 and DOW N4, we mean that there are elements 
x,y,z ER, x < y <z, such that x,z € UPa and ye DOWNag, or x,z € DOWNyg and y € 
UP,. 
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(a) 


(b) 


NS JN EN 


Fig. 4.5 (a) Improper OFNs. (b) The same OFNs interpreted using the MAX-choice principle 


derivation as the MAX-choice principle. This is because, for each given argument, 
it labels it with the maximal element out of all relevant values. 

Figure4.5 presents an effect of applying the MAX-choice principle for three 
examples of improper OFNs. Such a solution enables us to build a convex fuzzy 
set interpretation of an arbitrary OFN. The obtained sets are normal. This fulfills 
demands of standard scenarios of applying fuzzy numbers. Moreover, proper outputs 
of the considered procedure can still be interpreted as OFNs, if necessary. However, 
let us emphasize that the MAX-choice should be used only if transformation of an 
improper OFN to the proper one is truly needed. In particular, if there are any further 
calculations planned over a given improper OFN, then its transformation would mean 
losing information that might be potentially important later. 


4.5 Basic Operations on OFNs 


This section presents examples of calculations on OFNs. Their main idea is to oper- 
ate separately on the up and down parts. Such an approach allows us to conduct 
computations on OFNs directly on the universe of real numbers. It follows from the 
fact that we are now working with functions from [0, 1] to R. 


4.5.1 Addition and Subtraction 


Definition 4.10 LetOFNs A = (fa, ga), B = (fa, ge), and C = (fc, gc) be given. 
We can say that: 
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e C is the sum of A and B, denoted C = A + B, if for every a € [0, 1] there is: 


Sale) + fa(@) = fel) = gal@) + gB(@) = gcla) (4.15) 


e C is the result of subtracting B from A, denoted C = A — B, if there is: 


fale) — fa) = fel) = ga(@) — grœ) = gc(@) (4.16) 


Adding numbers A and B of the same direction (see Definition 4.3), which are 
described by linear up/down functions, allows us to obtain the same results as in the 
case of operations on standard fuzzy numbers [4]. Figure 4.6 illustrates adding two 
OFNs and transforming the obtained result to the standard form. 

More examples are presented in Figs.4.7 and 4.8. Figure 4.8 shows a result that 
is an improper OFN. Let us also note that, as we show later, the results of adding 
OFNs with opposite directions do not need to be improper. 

Figures 4.9 and 4.10 illustrate some examples of subtraction. In Fig. 4.10, again, 
we get an improper OFN as a result. 


operation on 


inversions 
+ A B of monotonic parts | 
ra aN S ——> 
inversion 


of the results 


Fig. 4.7 Adding two OFNs with negative direction 
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A C= A+B 


Fig. 4.8 Improper OFN as a result of adding OFNs 


C= B-A 
A B 


Fig. 4.9 A proper result of subtraction of OFNs 


Fig. 4.10 An improper result of subtraction of OFNs 


As discussed before, subtracting A should be the same as adding a number —A 
that is opposite to A. The ability of expressing —A for each A is, in our opinion, 
one of the biggest advantages of the OFN model, from the perspectives of both finer 
mathematical properties and managing imprecision during arithmetic calculations in 
practice. Let us recall that such a number can be introduced as —A = (f_4, g_a), 
defined as follows. 

f-a=—fa  8-aA=—8Aa (4.17) 


In particular, if B = A, then the number —A is added to A. Then, for every a € 
[0, 1], we obtain fco(a) = fa(a) — fa(a) = 0 and gc(a@) = gala) — ga(a) = 0. 
Therefore, the result of operation of the form A — A is the singleton representing 0, 
that is, the pair 0 = (fo, go) defined using formula (4.14) for x = 0 (see Fig. 4.11). 


Fig. 4.11 Singleton zero as a result of an OFN operation 
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In general, when considering different examples of operations on OFNs, we may 
obtain results that have no clear interpretation in a standard framework. However, 
whenever required, the previously discussed MAX-choice principle can be utilized 
to derive such an interpretation. Moreover, improper OFNs — such as those visible in 
Figs. 4.8 and 4.10 — still contain significant information and they can serve as inputs 
to further operations that might ultimately result in proper OFNs. 

Finally, we are now able to work with direction, an additional component of 
specification that illustrates a position of the OFN’s up part in relation to its down 
part. It is totally up to us whether that new component is used only as a purely 
mathematical property or it corresponds to a nontrivial real-world context. 


4.5.2 Multiplication and Division 


Definition 4.11 Let three OFNs A = (f4, ga), B = (fB, gp), and C = (fc, gc) be 
given. We can say that: 


e C is the result of multiplication of A and B, denoted C = A.- B, if for every 
a € [0, 1] there is: 


Fae) > fa(@) = fola) gala): ga(@) = gc(@) (4.18) 


e Cis the result of A divided by B, denoted C = A/B, if there is: 


Fao) /fa(@) = fola) — ga(a)/ga(a) = gc(@) (4.19) 


Multiplication of two OFNs is shown in Fig. 4.12. Certainly, division A/B can be 
formulated only under the constraint that B does not contain 0; that is, for every 
a € [0, 1] we have f(a) £0 and ga(a) Æ 0. 

As in the case of addition and subtraction operations, division should be express- 
ible as multiplication by an inverse number. For a given A = (f4, ga), its inverse 


Fig. 4.12 Examples of multiplication of OFNs 
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Fig. 4.13 Inversion of fuzzy number B 


A 


i C=A4-B'=A/B 


j= 


Fig. 4.14 Multiplication of A by B7! 


A`! = (f4-1, 84-1) is defined as follows. 


fa~ = 1/fa 8a = 1/ga (4.20) 


The division procedure is shown in Figs. 4.13 and 4.14. First, we determine an inverse 
number for B. As we can see, inverse numbers have opposite directions. Next, the 
inversion of B is multiplied by A and we obtain a result of dividing A by B. 

Although a real (precise) zero represented by the pair 0 = (fo, go) is a neutral ele- 
ment for addition, the neutral element for multiplication is the pair 1 = (f1, g1). An 
important property of the model presented in this chapter is the fact that multiplying 
any OFN by its inverse number allows us to obtain exactly the neutral element for 
multiplication as a result. 

This makes it possible to analyze OFNs from a more formal mathematical per- 
spective, analogously to some previous works on fuzzy number extensions [6]. Let us 
notice that the space of OFNs is isomorphic to a linear space of real two-dimensional 
vector-valued functions defined on the closed interval [0, 1], with a norm specified as 


||A|| = max( sup |fa(@)|, sup |ga(@)|) (4.21) 
we[0,1] «welo, 1] 


It is topologically a Banach space. The neutral element of addition is 0. We also have 
a Banach algebra with the unity 1 [19]. Hence, although in this chapter we focus on 
more basic operations, further studies on advanced mathematical characteristics of 
OFNs are surely possible. 
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4.5.3. General Model of Operations 


The most natural and intuitive way to introduce a general pattern of calculations on 
OEFNs is to define them pairwise on their up and down parts. Let us formulate such 
a pattern below. It represents all previous operations in a short form. 


Definition 4.12 LetOFNs A = (f4, g4), B = (fg, gg), and C = (fc, gc) be given. 
The sum C = A+ B, subtraction C = A — B, product C = A - B, and division 
C = A/B are defined by the following formula holding for every a € [0, 1]. 


Fo(a) = fala) x fa(@)  gcla)= ga(@) * grla) (4.22) 


where » replaces operations +, —, -, and /. Moreover, A/B is determined only if 
B = (fs, gp) does not contain zero values. 


In fact, x can represent any transformation of two OFNs under specific constraints. 
Such transformations have already been discussed and analyzed, including various 
examples in [9, 14]. Let us consider two further examples: 


Definition 4.13 Let A = (f4, g4), B = (fp, gg), and C = (fc, gc) be three OFNs. 
We can say that: 


e C is the result of exponentiation of A raised to the power of B, denoted C = A”, 
if for every a € [0, 1] there is: 


fea) = faa gola) = gala) (4.23) 


e Cis the result of the logarithm of A with respect to base B, denoted C = log, (A), 
if for every a € [0, 1] there is: 


fo) = 108 F(a) (Fal@))  gcla) = log, (a) (8a(@)) (4.24) 


Of course, as in the case of adequate operations for real numbers, the same restrictions 
should be applied with OFNs. During exponentiation, when the exponent is not an 
integer, the main limitation is exclusion as a base of those OFNs that contain negative 
values. In the case of logarithms, OFNs can contain only nonnegative values and, in 
addition, the base of the logarithm cannot include 1. 

In summary, the OFN model grants flexibility of a wide range of calculations on 
imprecise data in a similar way as in the case of real numbers representing crisp 
data. It retains fuzzy quantitative characteristics, but without the necessity to grow 
imprecision. While using the OFN model, one should certainly remember that its 
foundations are slightly different from the case of Zadeh’s fuzzy sets. In particu- 
lar, improper OFNs can appear. However, despite their unusual shapes, improper 
OFNs can still contain important information needed for calculations. In particular, 
in examples related to data processing in Sect.4.6.3, such objects are an important 
part of the analysis of information available in practice. 
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The above flexibility can be important for applications, where users expect a sup- 
port for multiple types of operations. For example, in relational database systems, 
SQL statements need to include a number of arithmetic expressions. In the litera- 
ture, one can find interesting examples of fuzzy-like histograms summarizing data 
contents that are employed to optimize database performance [20]. There are also 
database implementations aimed at acceleration of arithmetic calculations by means 
of interval ranges of values occurring for particular columns in particular data clus- 
ters [24]. Such solutions could be reconsidered by extending the currently utilized 
interval and trapezoidal summary structures with a concept of OFN-related direction. 
Namely, direction could be used to express a trend of values observed on data rows 
consecutively loaded into a database. 


4.5.4 Solving Equations 


This subsection shows how easy and flexible the calculations with OFNs can be. For 
standard fuzzy numbers, solving simple equations is often quite inaccurate. Surely, 
such solutions are expected if one follows the previously mentioned assumptions 
about accumulation of uncertainty during fuzzy arithmetic operations. However, one 
might also consider fuzzy equations for other purposes, for example, in order to set 
up some indirect embedded constraints for fuzzy variables. In such a case, it should 
also be possible to reverse a degree of uncertainty, that is, to obtain an equation’s 
result that would be less fuzzy than the equation’s coefficients. 

Examples in this subsection refer to solving an equation X = A + B, where A 
and B are known fuzzy numbers. Attention should be paid to the following two 
possibilities: B having a greater support than A (Fig.4.15), as well as A having a 
greater support than B (Fig. 4.16). 

In the framework of standard fuzzy numbers, for the first of the above possibilities, 
there is a solution although it cannot be obtained by a simple arithmetic operation. 
However, as for the second possibility above, the solution does not exist because there 
is no such standard fuzzy number that could be added to A to obtain an outcome 
with a narrower support. 

With use of the OFN model, both options are resolved in the same manner by 
simple calculation of X = B — A, which is presented by Figs.4.17 and 4.18. In 
particular, in Fig.4.18, we can observe that X has the opposite direction to A. 

Thanks to the freedom of algebraic operations on OFNs, we can also relatively 
easily deal with equations involving fuzzy polynomials defined by analogy to polyno- 
mials over real numbers. By a fuzzy polynomial P we mean a function that transforms 
each given OFN X = (fx, gx) into OFN specified as follows. 


P(X) = A,X" ht AX + A0 (4.25) 


where X is treated as a fuzzy variable and Ao, Aj, ..., An are called coefficients. 
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Fig. 4.15 Equation A + X = B with the right-hand side B being wider than its left-hand side 
component A 


A 
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Fig. 4.16 Equation A + X = B with the right-hand side B being narrower than its left-hand side 
component A 
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Fig. 4.17 Solution of the equation illustrated by Fig. 4.15 


Finally, itis worth emphasizing that this subsection is just a brief introduction to the 
problem of solving equations within the OFN model. For more detailed investigation 
we refer to Chap. 9, where OFN-based complex equations are considered for some 
applications in economy. More advanced examples related to utilization of OFNs 
in differential equations can be found in [11]. On the other hand, it is important to 
compare further the expressive power of the OFN model with other approaches with 
regard to fuzzy equation-solving methods [1]. 
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Fig. 4.18 Solution of the equation illustrated by Fig. 4.16 


4.6 Interpretations of OFNs 


The OFN model enables us to establish a quite efficient computational framework. It 
provides a new look at imprecision, however, it also has other consequences that need 
to be considered in applications. First of all, there is some inconsistency between 
OFNs and standard fuzzy numbers. This is understandable because OFNs are a larger 
class of objects. This aspect was commented on, for example, in [15, 21]. 

A potential for practical usage of OFNs also corresponds to their direction, an 
additional kind of information that is not represented by standard fuzzy numbers. 
This aspect turned out to be useful in many real-world scenarios, such as represent- 
ing trends in control processes, expressing diversity of opinions in social networks, 
modeling dynamics of financial data, and simulating brain functions [3, 7, 18, 23]. 

Interpretation of objects represented by the OFN model was discussed and ana- 
lyzed, for example, in [12, 22]. Here we present some revised aspects of that analysis. 
A common use of fuzzy sets is to represent the imprecise data, wherein fuzzy num- 
bers are dedicated to imprecise quantitative data. The OFN model is primarily created 
for representing and processing fuzzy quantities as well. Let us remember it when 
drawing further intuitions related to applications. 


4.6.1 Direction as a Trend 


Interpretation of OFNs comprises adapting a general idea of standard fuzzy numbers, 
with an addition of direction. By using OFNs, we can describe trends of imprecise 
quantitative values observed in real-world processes. The up and down parts of OFNs 
can be related, for example, to the experts’ opinions about dynamic changes of the 
analyzed values. In the following subsections, we refer to a couple of possible cases 
of direction interpretations. 

When using OFNs, we have two options. We can utilize their direction just for 
arithmetic purposes, or we can assign them with more complex information. In 
Fig. 4.19, we can see OFN A = (f4, ga), which represents a linguistic variable slow 
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Fig. 4.19 Fuzzy number about 20 with a growing trend 


corresponding to the speed of a vehicle. Formally, s/ow is a fuzzy set rather than a 
fuzzy number. On the other hand, the domain of possible velocities is an interval 
of real numbers, thus in practice slow will usually be represented by a triangular 
(or trapezoidal) convex fuzzy number (or fuzzy interval). Now, let us use the lin- 
guistic term about 20km/h instead of slow. By modeling it with the use of OFN 
A = (fa, 8a), We Can interpret A’s direction to say that it is about 20in the speed-up 
process. Thus, A’s direction extends application options, without diminishing the 
importance of standard fuzzy number interpretation. After all, information of a form 
about 20km/nh in the speed-up process is an extension of about 20 km/h. 


4.6.2 Validity of Operations 


The analysis of a fuzzy arithmetic model should also include verification as to whether 
the results of calculations are consistent with real-world expectations. 

According to the trend-based interpretation, let OFNs A and B visible in Fig. 4.20 
represent opinions prepared by an expert about two units of a financial company: A’s 
income is at a level of 3 million, with an upward trend, as well as B’s income is at a 
level of 6 million, with a downward trend. 

By using OFNs, the expert can actually describe not only a value and a trend but 
also an escalation of that trend. We have two OFNs with different spreads between 
their up and down components; indeed, object A is wider than B. By making the 
up part of B range from 7 to 6 million, the expert considers a potential of changes 
within | million. On the other hand, the up part of A ranges from | to 3, thus A could 
be recognized as a process that is more dynamic than in the case of B. 

Yet another aspect is the considered OFNs’ direction, which informs that B is a 
decreasing process and A is an increasing one. 

In reality, we would expect here the total income at a level of 9 million. If we 
use the OFN model and add numbers A and B together, then we get the anticipated 
results. However, as we can see in Fig. 4.21, we also have additional information that 
seems to be consistent with our expectations as well. Namely, the obtained result 
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Fig. 4.21 A result of adding both incomes 


shows that the trend is growing. Indeed, an increasing process related to A is more 
dynamic than a decreasing process related to B. However, because of B, the overall 
increasing trend is less dynamic than for A. 

The above example shows how interpretation of the OFNs’ direction can corre- 
spond to intuitions behind real-world observations. Such correspondence is important 
not only from a viewpoint of mathematical properties but also becomes useful at an 
operational level. In general, we believe that it can open new opportunities in front 
of applications of fuzzy numbers. Part III of this book presents more ideas about 
utilization of OFNs and their direction components. 


4.6.3 The Meaning of Improper OFNs 


Figure 4.22 illustrates a situation that is somewhat alternative to the example of 
income analysis considered in Sect.4.6.2. As before, A and B are incomes of units 
of a financial company. However, now their sum is an improper OFN. 

In this particular example, objects A and B are not symmetrical. They model a 
change in the income process. A represents an increase, which is slowing down. B 
represents a decreasing income, which is going to drop down even more. Thus we 
can expect the future dynamics of a sum of both incomes to be directed towards a 
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Fig. 4.22 Interpretation of improper OFN 


decreasing trend. Even for A — which is still growing — the future expectations (down 
part) present less potential than the past (up part). 

In summary, C represents a collapse of the upward trend of income for the whole 
company. This way, C contains information about a reversing trend. It shows that 
the idea of using OFNs to model changes of values is valid and intuitive. 

Analogous analysis could also be conducted for other examples of potential usage 
of OFNs. As mentioned in Sect. 4.5.3, one of them could be related to operating with 
data summaries within a massive data-processing framework [20, 24]. In sucha case, 
an improper OFN could mean that at the beginning of a data load process the values 
of a given column tend to increase to a certain most representative level, but later 
they begin to decrease again. In such a scenario, the trend-based interpretation of 
OFNs is related to a natural flow of data being loaded to a database system rather 
than the time of actual observation or measurement. 


4.7 Summary and Further Intuitions 


The main technical differences between the OFN model and standard fuzzy num- 
bers refer to inverting and ordering local components of a fuzzy membership func- 
tion. Such ordering has deep consequences for forming mathematical properties and 
implementing the model. It provides both (1) computational characteristics allowing 
us to define opposite and inverse OFNs (with respect to addition and multiplication, 
resp.), and (2) additional information, called direction, that is not present in previous 
approaches and that can be useful in practice. 

Usually, one is focused on a result of actions rather than their inputs. Thus, while 
dealing with functions, one tends to concentrate on their output values. In the case of 
fuzzy membership functions, outputs take a form of elements of the interval [0, 1], 
interpreted as truth values or degrees of compatibility. As for fuzzy numbers, the 
primary goal should be to model real numbers. In the case of OFNs A = (f4, ga), 
as well as an ordering representing their up parts and down parts, we indeed focus 
on the target real numbers induced by functions f4, ga : [0, 1] > R. 
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The emphasis on degrees of truth is proper while working with qualitative 
approaches corresponding to fuzzy logic. However, for quantitative approaches, such 
as those referring to fuzzy numbers, processing with the elements of R seems to be a 
good idea. Hence, OFNs should be considered primarily as an alternative to methods 
based on standard fuzzy arithmetics, rather than fuzzy logic. 

Surely, the outcomes of calculations obtained within the OFN model may in some 
situations be harder to interpret than in the case of far more popular convex fuzzy 
numbers. However, we hope that this chapter provided the readers with appropriate 
tools to let such an interpretation be sufficiently straightforward. 
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Chapter 5 
Processing Direction with Ordered Fuzzy 
Numbers 


Piotr Prokopowicz 


Abstract It was already mentioned in previous sections that the Ordered Fuzzy 
Number (OFN) model can represent a kind of tendency or direction. However, for a 
real practical use of this feature the tools for processing it are also needed. Of course 
some kind of quantitative processing is provided by the definitions of calculations, 
but there is much more potential for this feature apart from arithmetic operations. 
This part presents the idea of a property of processing data called sensitivity to the 
direction. The main focus here is placed on the proposition of a direction deter- 
minant parameter that can be understood as a kind of measure of a direction. This 
determinant is a basis for the definition of such elements as the compatibility between 
two OFNs and also for an inference operator for a rule where the OFNs were used. 
The propositions of such operations are the important part of these sections of the 
book. 


5.1 Introduction 


The Ordered Fuzzy Number (OFN) model introduces a new feature, the direction. 
It is the representation of order of the up-part and down-part of an OFN from 
Definition 4.1 in Chap. 4. It is used for defining those arithmetical calculations that 
do not have to produce more imprecise results. But there is another potential of this 
feature. In fact if we can use OFN to describe the situation, “A vehicle speed is about 
50km/h and it is growing,” it would be more efficient to have the potential to use it 
not only for calculations but also for more complex processing as, for example, in the 
tule, “IF speed is 50 km/h and is growing, THEN safety of a city drive is 75% but it is 
lowering.” In general, it is similar to the idea of the gradual fuzzy system (see [8]), 
however, the source of the OFN concept is quite different. An interesting approach 
to trend modeling using the classical fuzzy numbers idea is also presented in [11], 
where the trend is understood as a gradual dependence between attributes. However, 
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gradual fuzzy rules have a form, “The more X is F, the more Y is G,’ but here for the 
OFN model a more appropriate form is IF X is in F which is growing/decreasing, 
THEN Y is in G which is growing/decreasing. Moreover, the OFNs in a natural way 
represent a tendency unlike the classical fuzzy sets/numbers where modeling a trend 
requires additional actions. 

It was already presented in the previous chapter (see Sect. 4.7) of this book that the 
reversing of the axes in the definition of OFNs compared to typical fuzzy conceptions 
reverses focus in the analysis of the problems. Functions that form an OFN have a 
target set that is a universe of real numbers. It seems proper if we want to model a 
quantitative problem. This reversal does not prevent the OFN model from being a 
tool for an imprecise data representation. Additionally, arithmetic operations are not 
the only form of processing the quantitative values. One of great advances of fuzzy 
set theory is easy and intuitive modeling of the linguistic formulas with the reference 
rules. If we want to retain this advantage also for the OFN model we need a basic tool 
for comparing two values that can be called a compatibility. For practical linguistic 
use the compatibility is a result of the sentence or statement type A is B, where A 
and B are imprecise values, the OFNs in this case. 

Presenting the tools for the processing of OFNs other than direct calculations 
is the main goal of these sections of the book. The basic idea here is to preserve 
good intuitiveness of the general fuzzy approach and combine it with the tendency 
modeling potential of the OFN model. The methods presented in the next sections 
are sensitive to the direction (see [23, 25]). 


Remark 1 As the sensitivity to the direction we understand the property of opera- 
tion. This property means that the result can be different if we change the direction 
of the OFNs used in the operation. 


It should be noted that the above remark is a general postulate, not a formal 
definition of the property. The problem is quite complex, thus more explanation is 
needed. We especially postulate that the result changes if only one of the components 
(OFN) of the operation will change the direction (see Definition 4.2 the reversal of 
direction operation from Chap. 4). In many cases where two data items change a 
direction our intuition suggests the result should not be changed. For example, let us 
look at the linguistically described rules that consider tendency: 


e IF speed is decreasing THEN safety is increasing. 
e IF speed is increasing THEN safety is decreasing. 


Both of them express the same intuition, yet with opposite tendency, thus the change 
of direction for both values speed and safety should not really change the result. 
In addition, when analyzing sensitivity to the direction in the OFN methods, it is 
necessary to consider their specificity such as the improper OFNs (see previous 
chapter Sect. 4.4). Thus, a method that is generally sensitive to the direction may 
give the same result despite change where the up-part and down-part of the given 
OFN are equal. Apart from many improper OFNs such a situation will also arise in 
the singleton case. Thus the lack of change in the result for some specific situations 
does not negate the method as one that is sensitive to the direction. Therefore when 
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we postulate for a given method to be sensitive, the words “change of direction can 
(not must) change the result” are a clue. 

It is worth noting that the basic arithmetic operations on the OFN model presented 
in Sect. 4.5 are generally sensitive to the direction. If the up-part and down-part of 
OFN A are not equal, then the reversal of direction operation (see Definition 4.2 from 
previous chapter) generates A|~ + A. Therefore the result of an arithmetic operation 
will be different after reversal of the single input value. 

The purpose of this chapter is to propose a full set of methods and operations 
to define fuzzy systems based on OFNs that are sensitive to the direction feature. 
Therefore in the next sections, a general tool for processing a tendency of OFNs is 
presented. It is called the direction determinant (see also [24, 25]) as it is a kind 
of measure of direction for a given element of OFN support. Next the compatibility 
of OFNs as a result of statement A is B is proposed see [25] that uses the direction 
determinant. Finally a proposal of a technical inference method is presented that is 
meant to be a practical realization of the rule IF X is A THEN Y is B. 


5.2 Direction Measurement Tool 


The key element of the OFN model is the order between the up-part and down-part, 
which is independent of the real numbers. This can also be called the direction or 
orientation. It is taken into account in the definitions of arithmetic operations and their 
extensions, which make the calculations flexible and unified and more importantly, 
their properties and relationships are consistent with calculations on real numbers 
(see previous part of this book as well as [22]). Thus it seems natural that information 
processing methods based on OFNs also take into account the direction. Here the 
tool that allows meeting this assumption in defining methods is presented. However, 
it is helpful to start with a supporting structure that simplifies further description. 

In general, the propositions presented in this section refer to the concept of the 
membership function for the OFN model presented in Sect. 4.3.3. 


5.2.1 The PART Function 


The PART function as the result presents information about the part of the OFN that 
contains the given argument [24]. 


Definition 1 For the OFN A defined on X the PART function X — Y is determined 
as follows. 
CONST 4 : x € CONST 4, 
UP,: UP 4, 
PART œ) oe oe ATEMA (5.1) 
DOWN 4 Ix Ee DOWN 4, 


NONE, : x € NONE 4. 
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Fig. 5.1 Specific parts of the A 


support of an OFN + 
T T T T T > 
Xs X% Xi X; x, 
NONE UP CONST DOWN NONE 
where: 
xEX, 


Y = {CONST 4, UP 4, DOWN 4, NONE 4}, 
CONST 4 — A subset of X for which the membership function of A number is equal 
to 1. 
UP 4 — A subset of X for which the inverse of the up-part has values. 
DOWN 4 — A subset of X for which the inverse of the down-part has values. 
NONE 4 — A subset of X for which the membership function of A number is 0. 
Figure 5.1 illustrates the effect of the PART function. Example results presented 
there are as follows. 
PART (x1) = DOWN 
PART (x2) = UP 
PART (x3) = CONST (5.2) 
PART (x4) = UP 
PART (x5) = NONE 


Fuzzy numbers are fuzzy sets defined over the space (or subspace) of real numbers. 
Thus the sets UP, CONST, and DOWN can be treated as numerical intervals (see 
also Sect. 4.2 from previous chapter). We use the following denotations of their 
boundaries. 

UP = (s, 1°) 
CONST = [1-, 17] (5.3) 
DOWN = (1+, e) 


5.2.2 The Direction Determinant 


The direction of the OFN is an additional property in comparison with classical fuzzy 
numbers and its meaning is different from the degree of membership. Therefore, if 
we want to process the full information contained in the OFN, we need an additional 
parameter that will represent a new property. 
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Fig. 5.2 Proportional 
direction determinant 
calculations 


—_—— OO G: 
NONE UP CONST DOWN NONE 


The proposition is direction determinant (see [23—25]). The purpose of this 
parameter is to represent a kind of direction “intensity” of the argument. The direction 
determinant is strictly connected with a particular OFN and is defined only for its 
support (see Sect. 4.3.2). The general idea is to measure a distance of argument from 
the core of the OFN. It is calculated from the ratio of the position in support of the 
considered argument in relation to the whole fuzzy boundary of the OFN, to which 
this argument belongs. It is well illustrated in Fig. 5.2. 

Such an approach is connected with one of the useful interpretations of the OFN 
direction [13, 14]. The intuition behind the direction determinant is that the partial 
membership at the fuzzy boundaries can represent the imprecise concept of “now”. If 
we treat this imprecision as symmetrical, then our fuzzy “now” in the context includes 
as much time forwards as backwards. Hence, U P and DOWN in the scale of time 
(independently of the arguments) are equal. Thus there is a reason for calculating 
the determinant of the element situated on U P or DOWN to the proportion of the 
respective intervals and not only to the value. 


Definition 2 Let A denote the OFN, and x be an element of the support. The pro- 
portional direction determinant of x in relation to A marked dir? is calculated 
as a result of directional function D : suppa — (—1; 1) for the argument x in the 
following way. 


0 — : for PART(x) = CONST 
dir4 = Da(x) = { {=> : for PART) = UP (5.4) 


te : for PART(x) = DOWN 


The above-mentioned determinant is called proportional because this is a certain 
simplification/approximation of the general idea. This facilitates practical implemen- 
tation and still serves its purpose. 

It is worth noting that, if the degree of membership is equal to zero, the direction 
determinant is undefined, because the argument is not part of function domain D (the 
value is outside OFN support). It should also be noted that for the arguments in the 
CONST interval, we have the direction determinant that is equal to zero, which is 
justified, as these are the values about which we have no doubt: their membership is 
full (equal to 1). According to this intuition we should also expect (and this is taken 
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into account) that, the closer the arguments are to the kernel of the fuzzy number, 
their direction “intensity” (i.e., the direction determinant) is smaller. We should also 
note that the sign of the determinant clearly shows its membership to a selected part. 
If it is negative, it means that the argument belongs to U P, and if it is positive, then 
the argument is part of DOWN. Let’s call this the sign dependency. Thus in certain 
situations we can simplify the analysis. When processing the data represented by 
the OFNs we wish to include only the information about which part we deal with 
(up — part or down — part); the information about the sign of the determinant is 
sufficient without considering the exact value. 

Based on the above analysis, the trivial variant of direction determinant can be 
proposed. 


Definition 3 Let A denote the OFN, and x be an element of the support. The trivial 
direction determinant in relation to number A for x marked as dir, is calculated 
with the use of the value of the directional function D4 : suppa — (—1; 1) for the 
argument x in the following way. 


0 : for PART(x) = CONST 
dir’ = Da(x) = į —1: for PART(x) = UP (5.5) 
1 : for PART(x) = DOWN 


As can be noted, the trivial direction determinant simply remaps a set (U P, CONST, 
DOWN) into the set (—1, 0, 1). 

Having a basic tool, we can now propose the methods that are sensitive to the 
direction. 


5.3 Compatibility Between OFNs 


The fuzzy expression (or statement) “A is B” where A and B are fuzzy sets is a 
basis for the analysis where we want to apply the fuzzy sets and their imprecise 
mechanisms. The calculation result of this statement can be called a similarity or 
compatibility of A with B. The idea of compatibility and similarity between fuzzy 
sets was discussed in many publications (e.g., [5, 6, 12, 27]). 

In this section the idea for calculating compatibility between two OFNs is pre- 
sented [25]. We search methods sensitive to the direction, therefore a solution is to 
use the direction determinant in processing. Thus, as the result of fuzzy statement 
A is B a pair of values is proposed. First is a truth value in classical fuzzy meaning: 
the value from interval [0, 1], which indicates a degree of compatibility between 
two pieces of imprecise data represented by the OFNs. The second is the direction 
determinant, which retains information about direction. 


Definition 4 For Ordered Fuzzy Numbers A and B the result of expression “A is B” 
called directed fuzzy compatibility (DFC) and labeled COM P4g is composed of 
two values: the truth value T, and direction determinant D4pg calculated as follows. 
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A 
1 


truth value 


1 í 2 3 4 5 
Tas = Hg(1,5) = 0,25 Dag= Dg(1,5) = -0,75 


Fig. 5.3 The compatibility of a singleton with a general OFN 


COM Pag = (Tag, Das) (5.6) 
Tag = max (min(ua (x), ug (x))) : x E€ X (5.7) 

If T4g is zero, then D4pg is unspecified, else 
Dap = Dg(Xo), xo = x : pgx) = Tag (5.8) 


where X C R is a domain of given OFNs, ua(x), us(x) are membership functions 
of A and B, and Dg is the direction determinant of B for given x. 


Figure 5.3 shows the result of compatibility of A with B, when A is a singleton. 
For this example the truth value is T4g = 0, 25 and the direction determinant is 
Dag = —0, 75. The D4g can be interpreted as an indication of shifts of A to B. The 
negative values mean the shift in the direction of the up-part of B, and the positive 
shift in the direction of the down-part of B. Such behavior can also be understood 
as a kind of directed relative dependence between values. 

An Ordered Fuzzy Number can be understood as an extension of classical fuzzy 
numbers; the result of the fuzzy expression “A is B” should be an extension of the 
classical solution. It is important that the boundary dependencies for truth values 
are preserved in the new proposition. Especially when there is no shared part of the 
support between the numbers A and B, the truth value of the result is zero. On the 
other hand, when A is the same number as B, the truth value is equal to one regardless 
of the directions of the numbers. In addition to these results, we also achieve intuitive 
behavior of results with partial compatibility. 

It is understandable that the expression “A is B” in a context of the truth value is 
symmetrical. However, if we want use direction-sensitive methods we need a tool 
that gives us different results in such contexts as presented above in Definition 4. 

The examples in Figs. 5.4 and 5.5 present the results of DFC with different direc- 
tions of the OFNs. For both cases we can observe that truth value results are the 
same. But the difference is specified just by the direction determinant. 

However, for the opposite direction of OFNs (see Fig. 5.5) the direction determi- 
nants are the same. As we remember, the determinant part of the result indicates the 
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truth value 


Tapol gaqbp(2,5)=Ha(2,5)=0,5 Dap=Dp(2,5)=-0,5 
Dga=Da(2,5)=0,5 


Fig. 5.4 The compatibility between two OFNs with the same direction 


A 
1 


truth value 


down-part 


1 2 3 4 5 


Tap=Tpa=Hp(2,5)=Ha(2,5)=0,5 Dag=D3,(2,5)=0,5 
Dga=D,(2,5)=0,5 


Fig. 5.5 The compatibility between the OFNs with the opposite directions 


shift of A to B. For “A is B” A is shifted to B in the direction of the down-part of B, 
and for the “B is A” B is shifted to A in the direction of the down-part of A. Thus 
both shifts in the context of parts of OFNs have the same direction. 

To preserve usefulness the above compatibility with classical fuzzy ideas is impor- 
tant to retain some clue behavior. That is, if the truth value of compatibility is equal 
to 1, this means we are not analyzing the direction determinants. Such a solution 
preserves the boundary dependencies: when the truth value is zero we have no com- 
patibility, and with the truth value equal to one we have full compatibility regardless 
of the direction. 

It must be emphasized that the direction determinant can be used as a tool for 
measurement and comparison of the directions of OFNs in different ways. Methods 
concerning direction should use that parameter as an element in their definition, but 
if we want to use OFNs in data processing only for their good arithmetic then we can 
ignore the direction determinant and use only the truth value for further processing. 


5 Processing Direction with Ordered Fuzzy Numbers 89 


5.4 Inference Sensitive to Direction 


One of the main applications of fuzzy sets is a fuzzy system. Its core is a base of rules. 
Apart from the initial Chaps. | and 2 of this monograph, there are many publications 
that consist of the overviews of basic conceptions of fuzzy sets and modeling fuzzy 
systems [3, 16, 18, 19, 26]. The general advantage of fuzzy systems is the possibility 
to model the rules easily using linguistic description. 

The basis for the processing of fuzzy rules is the operators of inference. They 
describe algorithms for transferring given fuzzy input into a fuzzy answer. Generally 
these methods are based on implications. However, there are also popular solutions 
including the MIN or PROD, which formally are not the implications, but their 
practical usefulness is proved. If we deal with quantitative imprecise data, we can 
use the OFNs instead of classical fuzzy numbers. We can ignore the direction and use 
the same methods. However, if we want to process additional information contained 
in the new model, we need methods sensitive to the direction. 

When processing imprecise information using classical fuzzy methods, we often 
have fuzzy numbers at the input. However, during the process, in principle we ignore 
the quantitative nature of the data, focusing primarily on their qualitative aspect. 
Thus, even if input data are the fuzzy number, we rarely also get the fuzzy number at 
the output before defuzzification. In some cases it can be somehow inconsistent. For 
example, in the rule, “IF temperature is about 10°C THEN heating should be about 
200 W,” when processing data with classical fuzzy inference methods, in general, the 
output will not be a fuzzy number, although part of the rule, “Heating should be about 
200 W,’ clearly suggests a quantitative output. It can be particularly difficult in the 
cases where the result of inference is to be used as fuzzy data without defuzzification 
later for the calculations in further processing of this information. 

In the case of the OFN model and processing methods that can be called “arith- 
metic” (see [20, 21, 23, 24]), at each stage of the process we deal with the quan- 
titative aspect of the data. Thus consistently we obtain fuzzy numbers at each step: 
the aggregation of premises, the inference, and the accumulation-aggregation of the 
rules answers. 


5.4.1 Directed Inference Operation 


An inference mechanism presented here is based on the generalized modus ponens 
(compare with the information in Chap. 2), where the main role is played by a rule 
of the type: 

IF X is A THEN Y is B (5.9) 


where A, B are fuzzy values that model a rule and X,Y, input and output variables. 
In the generalized modus ponens, where the data are represented by fuzzy numbers 
(or sets), the whole mechanism of inference is closed in the mathematical rule. This 
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rule describes an algorithm for calculation of the answer, Y value. Sometimes it is 
also called an inference operator (see [9, 17]). 

The proposition presented here is dedicated for the OFN model, therefore in the 
rule (formula (5.9)) values are presented as such objects. The statement, “X is A,” is 
calculated as compatibility between OFNs. The method was described in the previous 
section. 


Definition 5 For the rule as in formula (5.9) let A and B be the OFNs. Let X be 
the input value also represented by an OFN. The result of “X is A” is calculated 
as directed fuzzy compatibility; COM Py, = (Txa, Dx), where Ty, is the truth 
value and Dy, is the direction determinant part of COM Py 4. 

The directed inference by the multiplication with a shift (DIMS) are the cal- 
culations of answer Y of the following rule: if Ty 4 = 0 there is no activation of the 
rule, therefore the answer is not calculated. In other cases, 


Y = B + |Dyxal: c 
where 

s—B : Dy, <0 
C= 

e—B: Dya > 0 


(5.10) 


It is worth noting that this is not the classical logical inference. The truth value 
of the premise part of the rule is used to check whether the rule can be implemented 
at all. The specificity of the presented method is that the inference is made through 
arithmetic operations. We do processing of the quantitative data with calculations. 


5.4.2 Examples 


For better understanding of the proposed method, an example is useful. Let us assume 
that for the rule from formula (5.9) we have OFNs A as in Fig. 5.6a and B in Fig. 5.6b. 
In Fig. 5.6a we can also find the input value X. 

According to the Definition 4 “X is A” is COM Px, = (Txa = 0.66; Dx4 = 
—0.33). Using the new inference we get the result shown in Fig. 5.6c. In Fig. 5.7a we 
have a situation where the X OFN value changes only a direction (but does not change 
the shape). This time the result of “X is A” is COM Py, = (Txa = 0.66; Dx, = 
0.33). As we can see in Fig.5.7b the result of inference was changed. This is related 
to the change of direction determinant. 

If we analyze the proposed method of inference in more detail, we can note that 
if the Dy, is closer to —1, the result of inference will be the narrow fuzzy number 
situated at the U P part side of support of OFN B. On the other hand, when the Dy 4 
approaches 1, the result of inference is aimed at extreme values of support but on the 
DOWN side. Finally, when Dy, = 0 and the Ty, = 1 it means that the X is fully 
compatible with A. Thus the result of inference is exactly the number B, the value 
from the conclusion. 
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Fig. 5.6 a Example OFNs X and A; b OFN B from rule conclusion, ¢ Y the result of inference 
operation 
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Fig. 5.7 a OFN A with opposite direction and X is the same as before; b the new Y result of 
inference operation 


In practical applications (a fuzzy system, e.g.), a pair of values should be consid- 
ered as a result of inference: the truth value of the premise part of a rule, and the 
OFN calculated in accordance with the Definition 5. 

Comparability with conventional fuzzy inference operators is important to pre- 
serve in general similar usefulness in practical situations for the new conceptions. 
Therefore, behavior of the output of the inference in boundary cases is compatible 
with classical fuzzy solutions (see [3, 18, 19]). If there is no compatibility in the 
premise part “X is A”, then the rule is not activated, and on other side if the activation 
is full, then the result is the exact value from a conclusion. 


5.5 Aggregation of OFNs 


A purpose of this section is to propose an aggregation operator that is generating 
intuitively good results as well as being consistent with the OFN model. The main 
basics of the proposition come from the paper [24]. The method presented here 
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maintains the expected properties of the aggregate functions [2, 4]. Additionally, it 
also takes into account the key idea of OFNs of the direction of the components. 


5.5.1 The Aggregation’s Basic Properties 


Generally, an aggregation is an operation used in those situations when we need to 
find a single value representing the set of various numbers/data. There can be different 
application areas specified where an aggregation [2] is needed, for example, making 
decisions based on multiple criteria, or choosing from a variety of peer evaluations, 
one of which is treated as the result of them all. One important area of application is 
also the aggregation of the rule premise in a rule-based fuzzy system, where we have 
many input variables. The aggregation operation is a function that converts a number 
of input data into a single value. Transformation depends on the chosen method, 
but it is expected that in the process of determination of the result all of the input 
data were considered (in some way). Typically, aggregations where the number of 
input data is greater than one are used. Moreover, to call a function an aggregation, 
it should have two elementary properties (see [4]): 


1. Boundary conditions. If all input data are minimal (or maximal), the result will 
also be the minimal (maximal) value. In the case of aggregation A for values 
from interval [0, 1] (the range of values of a fuzzy set), when all the arguments 
are equal to 1, the result of aggregation is also equal to 1 and similarly for zeros: 


A(0, 0, ...,0) = 0 


5.11 
Ad, 1,...,D =1 en 
2. Nondecreasing. The function is nondecreasing against each input variable. This 
means that the growth of any of the input data cannot cause a decrease of the 
result of aggregation A. 


Vin2.nXi S Vi A (1, os Xn) F O1 Yn) È> AM, s Xn) < AQ, 5 Yn) 
(5.12) 


Apart from these two elementary properties a number of other important properties 
such as continuity, symmetry (anonymity), and idempotency are pointed out [2, 4, 
10]. 

Continuity means that a small change in one input argument implies small change 
of the result. In the context of engineering applications, continuity corresponds to 
intuition, which is related to the fact that a small error in the entry cannot cause a 
large error in the output. 

Symmetry means the independence of the result from the sequence of input data. 
This property is also called anonymity, because based on the output it is not possible 
to determine the sequence of input values. 
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Idempotency means that if each independent input has the same value, this par- 
ticular value will be the result of aggregation. It may be noted that the boundary 
conditions are, in fact, idempotent for the maximal and minimal values. 

There are also many different properties that can characterize an aggregation 
operator [2, 4, 10]. However, those mentioned above are the most essential and 
desirable in practical applications. 


5.5.2 Arithmetic Mean Directed Aggregation 


The basic, simple, and intuitive idea is to use an arithmetic mean idea in aggregation. 
As the arithmetic operations (thus the adding too) are sensitive to the direction, there- 
fore the aggregation based on them also will be. The flexibility of the calculations 
grants a possibility for freely mixing the OFN objects with crisp numbers in math- 
ematical formulas. Thus we can define the aggregation exactly like the arithmetic 
mean for the real numbers and it will preserve the sensitivity to the direction. 


Definition 6 The result of arithmetic mean directed aggregation (AMDA) is OFN 
A calculated for L any set of OFNs such as: 


Li 
Acn, (5.13) 
n 


where L; € L is the ith OFN object from L, and n is the amount of elements in L. 


Figure 5.8 presents the example of aggregation of two OFNs. 


5.5.3 Aggregation for Premise Parts of Fuzzy Rules 


Definition 6 from the previous section is simply the direct transfer of the idea of 
arithmetic mean into the OFN space of all OFNs. However, the popular application 


1 2 3 4 5 


Fig. 5.8 Result of AMDA operation for two OFNs L; and L2 
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of the aggregations of fuzzy sets, and also fuzzy numbers, is a fuzzy rule with many 
input variables (see Chap. 2). Such rules have a premise part with a number of 
elementary fuzzy expressions of type “X is L”. For example, 


IF X, is Lj; AND Xz is La AND ... AND X, is L, THEN... (5.14) 


where X; are the fuzzy input data, L; is the fuzzy set/number from a linguistic model, 
and į = 1, ..., is the number of input variables in the rule. 

To use an OFN model in such a rule we need an aggregation consistent with 
the fuzzy expression’s compatibility calculation presented in Sect. 5.3. Below is pre- 
sented the proposition based directly on AMDA and designated specially for inference 
rules, and thus called arithmetic mean directed inference aggregation (AMDIA). 
It uses the direction determinant idea. The main purpose of the proposal is to calculate 
the level of activation or firing strength for a rule. 


Definition 7 Let’s assume that the general pattern of the premise part of a rule R 
is specified in formula (5.14). The result of arithmetic mean directed inference 
aggregation A pg of fuzzy expressions from the premise part of the rule R is calculated 
as a DFC (directed fuzzy compatibility see Sect. 5.3), thus it is a pair: truth value Tg 
and direction determinant Dr. 


Ar = (Tr, Dr) (5.15) 


The algorithm specifying Apr is presented as the following steps. 
1. Calculation of set A = {A, A2, ..., An} containing elements that are the results 


of all fuzzy expressions from the premise part 


A; = COM Px, = (Txit, Dx;,1;)- (5.16) 


Jr=0 > Tr = 0, Dris unspecified (5.17) 


If there is at least one fuzzy expression with the truth value equal to 0, then the 
truth value of the aggregation result is also zero. Therefore this rule is inactivated, 
and the direction determinant is undefined. 

3. Otherwise, 


Tr = mht, 
5.18 
_ D; (5.18) 
Dr = 3", —. 
n 


The proposed aggregation operator for the OFN generates a result with two com- 
ponents. For the calculation of each of them the arithmetic mean is used. Because 
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the arithmetic mean is a function fulfilling the basic criteria of aggregation operators 
(see [2, 4, 10] and Sect. 5.5.1), the AMDIA also fulfills them. 

It is worth noting that we are dealing with two different parameters: the truth 
value (degree of membership) and the direction determinant. However, they are 
not completely independent, therefore, it is worth having a look at some important 
dependencies between them. The direction determinant of the result equal to zero 
indicates that the activation is not moved from the CO N ST interval in any direction. 
Note that this happens only in two cases: 


1. When all truth values of the fuzzy expressions from the premise part are equal 
to one, then activation of the rule (truth value of aggregation result) will also be 
equal to one. 

2. When the truth values of the fuzzy expressions on the U P side are precisely 
balanced with the resultant on the DOWN side, then the truth value of the result 
will be greater than zero, and less than one. 


Let’s take a closer look at the first case. The level of activation may be only equal 
to 1 when the determinant is equal to zero. This means that in the case of complete 
compatibility of premises the given data do not represent any direction. This is 
especially important if we want to combine the concept of OFNs with the ideas for 
classical fuzzy sets. In such a way the fundamental meaning of full membership (also 
the full nonmembership) coincides in both solutions. 

Finally, an alternative conception should be analyzed. It may be tempting to use 
the geometric mean instead of arithmetic in the aggregation. It seems good for truth 
values, due to the fact that if we have zero for at least one input, it is automatically 
zero for the truth of aggregation result and generally cancels the rule from further 
computations. Unfortunately, for the same reason it may not be used for calculating 
the direction determinant part of the result. The zero value of the direction determinant 
of elementary fuzzy expression means in most cases full compatibility (truth value 
equal to one). It is against intuition that only one full compatibility of one fuzzy 
expression will automatically grant no direction for the aggregation result, no matter 
how many other expressions have only partial compatibility. 


5.6 Summary 


All sections of this chapter can be treated as an introduction to tendency-sensitive 
data processing with the use of Ordered Fuzzy Numbers. The basic tool for linguistic 
modeling is the operation directed fuzzy compatibility used to calculate a result 
of the expression, “X is A”. The inference operator DIMS is another important tool 
for the practical use of sensitivity to direction. Both propositions use an idea of the 
direction determinant, which can be treated as a general parameter for measuring 
direction. Together these propositions can also be used for practical defining and 
realization of the full fuzzy system based on rules type “JF-THEN”, which is sensi- 
tive to the direction/tendency of information presented by OFNs. If a fuzzy system 
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needs rules that use more input values there is the proposal of the arithmetic mean 
directed inference aggregation method which is also based on the idea of direction 
determinant. 

To generate one fuzzy answer from all rule outputs a simple calculation can be 
used. It is the idea of weighted mean where weights are the levels of activation of 
the rules (see [21]): 


(5.19) 


where k is the amount of rules, a; is the value of activation for the i rule, and Yp; is 
the OFN output for the i rule. For such calculations the result will always be an OFN. 
A key observation for this solution is that rules that were not activated (activation 
equals 0) have no participation in the final result. Calculation of the fuzzy answer of 
all rules results is also a form of aggregation (see Sect.5.5), sometimes also called 
an “accumulation.” 

When we have one OFN as the result of a system, we can defuzzify it. For this 
purpose, we use one of the classic fuzzy methods as the mean of maxima, or the center 
of mean inclination method mentioned in Definition 4.4 from previous chapter. It 
is based on the specific parameter of OFN, an inclination. As the aggregation of 
premises and inference operator are sensitive to the direction, the OFN-based fuzzy 
system will also be characterized by this property. Therefore, the accumulation and 
defuzzification methods proposed above do not need to fulfill the sensitivity postulate. 

It should be underlined that defuzzification is a very important operation in terms 
of the practical usefulness of fuzzy concepts. There can be many applications where 
fuzzy elements are helpful but without rule/inference processing. This applies par- 
ticularly to quantitative problems, when we need to calculate the result where data 
are fuzzy. Therefore developing the defuzzification methods independently of the 
fuzzy system application is an important issue. The next chapters in this part of 
the monograph (see also [1, 7, 15]) present other ideas and propositions to realize 
defuzzifications that consider specificity of the OFN model. 
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Chapter 6 
Comparing Fuzzy Numbers Using 
Defuzzificators on OFN Shapes 


Jacek M. Czerniak, Wojciech T. Dobrosielski and Iwona Filipowicz 


Abstract This chapter concerns an issue of comparing fuzzy numbers. The relation- 
ship of similarity is probably the most widely used and most difficult to determine the 
measure of compliance precisely. Analysis of the similarity between two objects is 
an essential tool in biology, taxonomy, and psychology, and is the basis for reasoning 
by analogy. This chapter describes methods for determining the similarity used in 
fuzzy logic. Many of them were dedicated only to triangular or trapezoidal fuzzy 
numbers. This was a computing inconvenience and raised the question about the axi- 
ological basis for such comparisons. The authors have proposed two new approaches 
to comparing fuzzy numbers using one of the known fuzzy number extensions that 
are Ordered Fuzzy Numbers (OFNs). This has allowed us to simplify operations and 
eliminate said dualism. Two order-sensitive defuzzification methods are presented 
in the chapter. For OFN numbers with positive order (compliant with the direction 
of the OX axis increase) the results of defuzzifications are results for numbers of 
different notations, for example, L-R, whereas for numbers with negative orders, the 
defuzzification result changes. An important part of the chapter is a catalogue of 
the shapes of numbers in OFN notation. This is probably the first summary of basic 
shapes of those numbers with the results of defuzzifications using several methods. 
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6.1 Introduction 


In all fields of science for a long time it was necessary to compare certain objects. 
Some branches of science sought to answer the question about the nature of the 
similarities, whereas others needed precise formal definition. Comparison of two 
objects or occurrences can be seen as an attempt to determine the relation between 
them. The most important and most frequently used relations between objects are 
similarity, difference, and inclusion. In the literature, most attention is dedicated to 
the issue of the similarity of objects. In recent decades, the theory of fuzzy sets has 
been used in many areas of science and everyday life. The need to compare fuzzy 
sets emerged naturally from the very beginning of the theory. There are plenty of 
methods, often based on those used for conventional sets. Intensive development 
of fuzzy logic and its applications often need to identify new ways of comparing 
objects. This issue is particularly important in computer-aided decision support, 
classification, and processing of natural language. Although the issue of comparison 
is crucial for many applications of fuzzy set theory, still we failed to formalize clearly 
basic concepts such as similarity or inclusion. Some researchers concerned with fuzzy 
logic seek to define the concepts precisely, however, others questioned this approach, 
saying that imposing a rigid framework limits practical applications. Through years 
of development of fuzzy logic, many researchers have been developing methods of 
comparing sets and fuzzy numbers. Among them, it is impossible not to recall that 
several fuzzy number comparison methods and indices have been researched since 
1977 by Zadeh [12], Yager [10, 11], Kaufman [14, 15], Chang [5], and Amado [1]. 
Bortolan and Degani [5] and Dadgostar [1] reviewed some of the methods for ranking 
fuzzy sets, including Yager’s first, second, and third indexes, Chang’s algorithm, 
Adamo’s method, Baas and Kwakernaak’s method [2], Baldwin and Guild’s method 
[3], Kerre’s method [9], Jain’s method [7, 8], and Dubois and Prade’s four grades [6] 
of dominance (PD, PSD, ND, NSD). Dadgostar and Kerr [1] proposed a consistent 
method, called the partial comparison method (PCM). Wang and Kerre [22, 23] 
proposed several axioms as reasonable properties to determine the rationality of a 
fuzzy ordering or ranking method and systematically compared a wide array of fuzzy 
ranking methods. 

It appears that although defuzzification in some way deprives a fuzzy number 
of multidimensionality, this is a natural step preceding the comparison. Subsequent 
sections present some known defuzzification methods and two new methods proposed 
specifically for Ordered Fuzzy Numbers (OFNs). It has been proven that both new 
methods meet properties required for defuzzification operators. 
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Fig. 6.1 a OFN example, b OFN presented in relation to a classic fuzzy number, ¢ arrow denotes 
the orientation and the order of inverted functions: first UP and then DOWN 


6.2 Formal Approach to the Problem 


The essence of an OFN is discussed in the introduction to this chapter. Redefinition 
of classic fuzzy sets, where, according to Zadeh, it is an organized pair, has widened 
the definition by an organized pair of functions. The OFN is defined as follows. 


Definition 1 
A= Xup» Xdown) (6.1) 


where Xup, Xdown : [0, 1] —> R are continuous functions. 


These functions are called the up-part and down-part, respectively, where both 
parts are connected by a constant function equal to 1. The order of a fuzzy number 
is its arrangement so that the up-part is the beginning of the OFN and the down-part 
is the end of this number. 

Interpretation of the Ordered Fuzzy Number is shown in Fig. 6.1, where an exam- 
ple of an OFN is referred to a classic fuzzy number. The defuzzification process, 
as the last step in the three-step model of fuzzy control, converts a fuzzy set into a 
single real (defuzzified) value, on which the membership function is defined. The 
following expression describes defuzzification in a formal way. 
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Definition 2 
W = {f : X > [0,1]}—> X (6.2) 


where W is the defuzzification operator, f is the membership function, and X the 
universe on which membership functions are defined. 


The process can be characterized on the basis of the properties, which are more 
desirable for a particular system. Considering the type of system, one can distinguish 
a fuzzy inference system, for which such property as processing power, is less impor- 
tant than for a diffuse control system, for which the processing power is an important 
parameter. The study [35, 37] introduced criteria of defuzzification operators for 
classic fuzzy numbers, on the basis of which individual defuzzification methods 
were assessed. The main conclusion is that there is no all-purpose defuzzification 
method. Defuzzification methods should be oriented to their field of application. For 
example, maximization methods, which include LOM (last of maxima) and FOM 
(first of maxima), are more suitable for inference systems. Research, which has been 
carried out by the authors of the above-mentioned study, proved that the distribution 
and field methods are more suitable for applications where control systems are used. 
Those methods include COG (center of gravity) and COA (center of area). 

Upon development of Ordered Fuzzy Numbers, the authors of the paper [7, 20, 
26] proposed criteria for defuzzification methods. That gave grounds for guidelines 
enabling the creation of suitable models of defuzzification operators. The following 
four conditions should be met for most of the methods. 


Definition 3 Each functional ¢ is defined on R with the properties: 


p(c) =c (6.3) 
g(A+c)= (A) +c (6.4) 
(cA) = ch (A) (6.5) 
p(A)>=0 if AZO (6.6) 


is called a defuzzification functional, 

where ¢ is a representation defined on the set of real numbers, and ¢ (c) is under- 
stood as the defuzzification of the c value on the set of real numbers. In other words, 
the defuzzification using the singleton method should give a defuzzified number (6.3). 
Condition (6.4) is related to additiveness, and it requires the defuzzification value for 
the sum of components to equal the sum of defuzzifications for individual compo- 
nents. Condition (6.5) requires the representation ¢ to be homogeneous (first degree); 
that is, if the argument is multiplied by a factor then the result will also be multiplied 
by some power of this factor. In this case, that power amounts to one. Condition (6.6) 
refers to the positive sense of a functional. Detailed interpretation of individual con- 
ditions is provided in the study by [5, 30]. 
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6.3 Defuzzification Methods 


It is well known that the defuzzification process reduces the fuzzy set to an individual 
defuzzified value. The mechanism of that operation consists mainly in the use of an 
appropriate defuzzification method. Available methods include the following classic 
solutions. 

FOM, first of maxima: This method is FOM a method concerning the choice 
of the smallest element of the set core A, where the defuzzification value represents 
the relationship (6.7). 

FOM(A) = min core(A) (6.7) 


LOM, last of maxima: The appropriate choice of the maximum value of an 
element from the set core A, is the LOM method, the formula of which is presented 
below: 

LOM (A) = max core(A) (6.8) 


MOM, mean of maxima: The formula (6.9) illustrates the use of FOM and LOM 
as methods, the defuzzification values of which take into account the minimum and 
maximum elements of the fuzzy set core A. The resulting value is the mean value of 
those two methods. 


MOM(A) = min core(A) + max core(A) (6.9) 


RCOM, random choice of maxima: The method is also called defuzzification 
from a core, because the defuzzification value is always included in the core of a 
fuzzy set. The defuzzification value of this method is a random element x € core(A) 
calculated as a probability: 


RCOM (A) = P(x) = — ae (6.10) 
à (core(A)) 


where A is the Lebesgue measure in universe X. 
MOS, mean of support: Defuzzification method MOS, the defuzzification value 
of which is the mean value of the A number carrier. 


MOM(A) = supp(A) 


(6.11) 


COG, center of gravity: The most widespread method, which is based on deter- 
mination of the center of gravity of the analyzed system. In the fuzzy number A 
defuzzification process, the COG method is expressed as the formula (6.12). 
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tba Xa (x)dx 


COG(A) = 
J? nad 


(6.12) 


BADD, basic defuzzification distribution: The defuzzification method pro- 
posed [24] as an extension of COG and MOM methods. We obtain the following 
defuzzification value from the fuzzy set A. 


p xu% (x)dx 


BADD(A) = 
Je Hh @odx 


(6.13) 


Depending on parameter y € [0, 00], BADD may assume the following instances: 
when y = 0, BADD(A) = MOS(A); when = 1, BADD(A) = COG(A); and when 
y — œ, BADD(A) = MOM (A). 


6.3.1 Defuzzification Methods for OFN 


Classic defuzzification methods presented in the above parts of the chapter are 
reflected in Ordered Fuzzy Numbers. In the analysis of methods shown below, one 
of their explanations includes important characteristic elements of OFNs presented 
in Fig. 6.2. 

In the definition of an Ordered Fuzzy Number expressed by the formula (6.1), an 
Ordered Fuzzy Number. A can also be defined, according to other approaches to that 
subject, as an oriented pair of continuous functions: 


A = (fa, 8a) (6.14) 


Fig. 6.2 An OFN number 
and characteristic elements 
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where f4, ga : [0, 1] — R. The function f, is called the up-part UP, (beginning) of 
an Ordered Fuzzy Number A, and the function g4 is called the-down part DOWN, 
(end) of an Ordered Fuzzy Number A. 

In the interpretation of OFN defuzzification methods, the value of the f4 function 
for 0 is f4, for 1 is f4(1), and of the g4 function it is: for 0 g4(O) and for 1 is g4(1). 


drouf, 8) =f) (6.15) 
dron (f, 8) = 800) (6.16) 
1 1 
mom (f, 8) = T (6.17) 
drou(f.3) = tf + A — ¢)gC1), ¢ = [0, 1] (6.18) 
bcocf, 8) = 
Looe for fo FO — Olds # 0 (6.19) 
hot „for Jy f(s) — g(s)lds = 0 
rapp (A, A) = 


(6.20) 


fi obo Uf (s)—g(s)|-s* lds for x [0 1] 
to If (s)—g(s)|-s*-lds 3 , 


fA) - 80) —f 0) g0) 
P = 6.21 
boul 8) EE oon 


The above formulas (6.15—6.21) are interpretations of classic defuzzification meth- 
ods. In the discussed OFN theory [30] and in earlier studies, the geometrical mean 
method is proposed, which was created by D. Wilczyfiska-Sztyma [38]. 


6.4 Definition of Golden Ratio Defuzzification Operator 


At this point we present a proposal for a new method of defuzzification of a fuzzy 
controller, which is based on the concept of the golden ratio (GR), derived from 
the Fibonacci series. The origin of the method was the observation of numerous 
instances of the golden ratio in such diverse fields as biology, architecture, medicine, 
and painting. A particular area of its occurrence is genetics, where we find the golden 
ratio in the very structure of the DNA molecule (deoxyribonucleic acid molecules 
are 21 angstroms wide and 34 angstroms long for each full length of one double helix 
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cycle). This fact makes the ratio in the Fibonacci series in some sense a universal 
design principle used by man and nature alike. 

The Fibonacci series is based on the assumption that it starts with two ones, and 
each consecutive number is the sum of the previous two. The proposal for the golden 
ratio method of defuzzification is based on the proportion of the golden ratio. As a 
result of dividing each of the numbers by its predecessor, we always obtain quotients 
oscillating around the value of 1.618, the golden ratio number. The exact value of 
the limit is the golden number itself: 


kn 
lim = 1, 618033998875 - -- = @ (6.22) 


n>0 Ky 


The possibility of using this formula in the process of defuzzification is another 
example of the universality of the method, as it is applied in the new domain of fuzzy 
logic theory. Calculation of the classical formula of the golden mean assumes that 
two values of line segments a and b are in golden ratio ® to each other if: 


b 
E E (6.23) 
a b 


In this case, one method of finding the value of @ is to transform the left-hand 
fraction of Eq. (6.23) into: 


DE aye aa gp al (6.24) 
= = = aay Te = S>S —— 7 
a @ ee a @ 


Following subsequent transformations of Eq. (6.24) we obtain the quadratic 
Eq. (6.25), for which we calculate the roots. 


292120 (6.25) 
As appropriate, using transformations of the formula in (6.25), we obtain two 


square roots (6.26). 
14+ /5 1-5 
5 or , = 5 


(6.26) 


1 = 


In view of the fact that the value of ® must be positive, in our example we select 
the positive root, as in Eq. (6.27). 


1475 
— 2 


= | 


= 1, 618033998875... (6.27) 


In sum, the ratio between two objects a and b is called the golden ratio when the 
value of © = 1.61803398875.... 
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supp(A) =a+b 


crisp value 


Fig. 6.3 Golden ratio defuzzification value 


The method of the golden ratio for a fuzzy number is Eq. (6.28): 


Definition 4 
|supp(A)| 


p (6.28) 
where ® = 1, 618033998875... 


GR = min(supp(A)) + 


where GR is the defuzzification operator and supp(A) is the support for fuzzy set A 
in universe X. 


6.4.1 Golden Ratio for OFN 


The mathematical formula (6.28) of the equation as well as the graphic interpretation 
presented in Fig. 6.3 applies to convex fuzzy numbers. In reference to the OFN, which 
has orientation, we should use another equation. Therefore, the interpretation of the 
proposed method is shown in Figs. 6.4 and 6.5. 

We note that the individual parts of the two values of line segments a and b take 
up positions in relation to direction of the OFN. In the first case we have a positive 
OFN where a larger part of the golden ratio starts from base point f (0). In the second 
case, which is negative OFN, we have a base point as g(0). The method of the golden 
ratio for OFN is Eq. (6.29): 
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supp(A) |=a+b 


crisp value 


Fig. 6.5 OFN number B = [10, 4, 2, 0] 


Definition 5 
GR(A) = 
min(supp(A)) + [seen if order (A) is positive 
p (6.29) 
|supp(A)| 


max(supp(A)) — , Uf order (A) is negative 


$ 
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The instrument of the golden ratio, as proposed in this chapter for fuzzy numbers, may 
serve as another defuzzification method. As a mathematical apparatus that affords 
wide-ranging possibilities in description and processing of information, it becomes a 
new solution in constructing models of fuzzy controllers used as tools for inferencing 
or control. 


6.5 Golden Ratio 


Let 
ga(O) — fa (0) if ordered A is positive 
supp(A) = (6.30) 
fa(O) — ga(O) if ordered A is negative 
Let 
fa(0) if ordered A is positive 
min(supp(A)) = (6.31) 
ga(O) if ordered A is negative 
Let 


ga(0) if ordered A is positive 
max(supp(A)) = (6.32) 
fa(O) if ordered A is negative 


Symbol @ is designated with a golden number, as ® = 1, 680.... 


Definition 6 The functional ggr : R > R, called the golden ratio, is expressed with 
the formula: 


supp(A) 


min(supp(A)) + if ordered A is positive 


PGR = supp(A) (6.33) 
(o 


max(supp(A)) — if ordered A is negative 


Theorem 1 Mapping of ocr : R > R expressed with the formula (6.33) is a defuzzi- 
fication functional. 


6.6 Defuzzification Conditions for GR 


Recall that, by the definition of adding fuzzy numbers and multiplication of a fuzzy 
number by a real number, the following equalities apply. 


Sater (s) = fa (s) +c oraz ga+c+ (s) = ga (s) +c (6.34) 
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dla s € R oraz ct -crisp number 


feas) = c -fa (s) oraz 8ca (8) = C+ 84(8) (6.35) 
dla s € R 
It is easy to see that 
supp(A + c) = supp(A) (6.36) 
supp(c - A) = c- supp(A) (6.37) 


Namely, using (6.34) we obtain the following for A of positively ordered numbers. 


supp(A + c™) = 84+e+ (0) — fazer (0) = g4 (0) + ¢ — fa (0) — c = supp(A) (6.38) 


By analogy, we obtain (6.36) for A of negatively ordered numbers. 
In order to show (6.37) for A of negatively ordered numbers we use (6.35). 


supp(c : A) = gea (0) — fea (0) = c + 84 (0) — c - fa (0) = c - supp(A) (6.39) 


By analogy, we prove (6.37) dla A of negatively ordered numbers. It follows directly 
from (6.34) and (6.35) that 


min(supp(A + ct)) = min(supp(A)) + c and (6.40) 
max(supp(A + c*)) = max(supp(A)) + € 


and 


min(supp(c - A)) = c-min(supp(A)) and (6.41) 
max(supp(c - A)) = c- max(supp(A)) 


6.6.1 Normalization 


Proof normalized (6.3) 
The normalization property results directly from the definition of 6, because 


+ $ ak 
gcr(c™) = min(supp(ct)) + spet ) are (0) > ct (0) ae 


(6.42) 


Therefore, we have shown that ggr fulfills the homogeneity condition; that is: 


gor(ct) =c (6.43) 
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6.6.2 Restricted Additivity 


Now let us show the restricted additivity property. 


Proof restricted additivity (6.4): 
From the Definition 6 of the golden ratio functional, we obtain 


A + 
gor(A + ct) = min(supp(A + ct)) + supers) (6.44) 
for positively ordered A 
and A+ct 
gcr(A + c+) = max(supp(A + c*)) + were) (6.45) 


for negatively ordered A 


It follows directly from (6.40) and (6.36) that 


Gee cl it eat ee 
PGR = pp @ = PGR 6.46 
(6.46) 
for positively ordered A 
and 
A 
gor(A+ct)=c+t (maxsu g ’) = verte AN 


for negatively ordered A 


Therefore, we have shown that gp fulfills the restricted additivity condition; that is: 


gor(A + ct) = gor(A) + c (6.48) 


6.6.3 Homogeneity 


Proof homogeneity (6.5): 
Based on the Definition 6 we obtain the following. 


supp(c - A) 
@ (6.49) 
for positively ordered A 


Yor(c - A) = min(supp(c - A)) + 


and 
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supp(c - A) 
@ (6.50) 
for negatively ordered A 


Yar (c - A) = max(supp(c - A)) + 


It follows directly from (6.41) and (6.37) that 


porle A) = c - min(supp(A)) + ZPE 


supp(A) (6.51) 
p 


=g: (mineva) + 
for positively ordered A 


and A 
SU T 
porle A) = c max(supp(A)) + = 


supp(A) ) (6.52) 
p 


=c- (mmaxiouppcay + = C+ GR 


for negatively ordered A 


Therefore, we have shown that 
gar(c- A) = c- gGr(A) (6.53) 


The equalities (6.43), (6.48), and (6.53) imply that g is a defuzzification func- 
GR 


tional, which was to be proven. 


6.7 Definition of Mandala Factor Defuzzification Operator 


Buddhist monks can create amazing pictures with colored sand grains. Those pictures 
are called mandala. It is difficult to name them paintings because we expect paintings 
to be rather more lasting. Anyone who has ever seen meditating monks creating, grain 
after grain, a previously designed picture, remembers such a conclusion for a long 
time. You can observe the beauty of their art and on the other hand the transitory nature 
(in the literal sense) of the technique they use is evident. The same reverence is seen 
in Christianity in the Eastern Orthodox rite when icons are painted, but fortunately 
for culture and art, the effects of the work can be seen for a long time. The Buddhist 
mandala is a harmonious combination of a wheel and a square, where the wheel is 
a symbol of heaven, transcendence, externality, and infinity, and the square depicts 
the inner sphere, that is, the matters associated with a human and the earth. Both 
figures are linked by the central point, which is both the start and end of the entire 
system. The mandala creation process itself, as well as its destruction, is a religious 
act (Fig. 6.6). 
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The mandala factor defuzzification operator is inspired by mandala. Let A be 
a given fuzzy number shown in Fig. 6.2. Let it assume the shape of a trapezoid in 
Fig. 6.7a. A trapezoid can in a particular case come down to atriangle, but we remain 
at a trapezoid, which makes our analysis more universal. Then one must fill in the 
outline marked by the sides of the number and the OX axis with virtual grains of 
sand in Fig.6.7a. A number of virtual sand grains are collected in this way. Then 
one must construct a rectangle, the base of which is equal to the support value of the 
fuzzy number. The rectangle built in such a manner should be filled with virtual sand 
grains, starting from the outermost left side in Fig. 6.7b. The filling process should 
be done vertically in columns until all grains are used. A real number obtained as a 
result of defuzzification is the value above which the last filled column was finished. 

Mathematical formalism (6.54) of the above-described mandala factor visualiza- 
tion is shown below. Calculation of the R value uses the mandala factor Yy for the 
rising edge, falling edge, and core set function integral. Then the obtained value 
should be scaled from the center of the coordinate system by adding it to the start 
of the support value of the fuzzy number. When defuzzification is performed in the 
OFN arithmetic, then in the case of a positive order, one should proceed as described 
below, whereas in the case of a negative order, one should deduct the calculated value 


Fig. 6.6 Mandala creation 
http://wellness.gcublogs.org/ 
tag/sand-mandala/ 


= pale) 
i» 


crisp value 


Fig. 6.7 Mandala factor visualization 
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from the first coordinate of the OFN corresponding to the outermost right side of the 


OFN support. 
Definition 7 

HE e te 
where 


6.8 Mandala Factor 


(6.54) 


(6.55) 


Definition 8 The MF : R — R, called the mandala factor, is expressed by the for- 


mula: 
fa) + A if ordered A is positive 


MENS fo (0) =r if ordered A is negative 


where 
fad) faa) 


= 1 J O AO J“ 
CS SSS xdx — 
Aa fa) =a A fad) -A40 


ga (0) ga (0) 


840) xdx 


840) — ga) | 8a (0) — ga) 
8a (1) 


ga(1) 
ga(1) 


+ J dx 
fa) 


and r4 = 0 for A such that f4 = const lub g4 = const (in particular r,+ = 0). 


6.9 Defuzzification Conditions for MF 


Proposition 
The mandala factor is a defuzzification functional. 


(6.56) 


(6.57) 
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6.9.1 Normalization 


Proof normalized (6.3) 
It results directly from the definition that 


MF(ct)=c+ r=c (6.58) 


fulfills the normalization condition. 


6.9.2 Restricted Additivity 


Proof restricted additivity (6.4): 
Based on the definition of the mandala factor, we obtain the following. 


f ©)+ r if ordered A is positive 
+ Atct 


+) _ J Atc 
oe) = g 0- Jr if ordered A is negative 0:97) 
A+ct +ct 
whereas 
a) a) 
i Z f ©) Atet 
E Sc J xdx Ake dx 
Avett fa- f (0) f y= f © 
A+c+ A+ct f (0) A+ct At+ct f (0) 
A+ct A+ct 
g (0) § © 
gO) ae a 
A+ct 
p— r f ite J xdx (6.60) 
g ©- 8 (0) g ©- ¢ (0) 
A+ct A+ct g () A+ct At+ct g 0) 
Atet A+ct 
8 d) 
A+ct 
+ J dx 
fo 
A+ct 


In view of the above Eqs. 6.60 and 6.56 to show the restricted additivity property it 
is sufficient to demonstrate that 
=r (6.61) 


Operations on OFNs imply that 7, 
SE 
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f () = UFR 


A+ct 
g (8) =a) +e co 
A+ct A 
First, we note that 
j d+c f a) 
J dx =f (1) — f (0) = J dx (6.63) 
A A 
f ()+e f 0) 
and 
f d)+c 
J xdx = 
J@+e 
1 2 2 
z (C) = (ro) J+ c (œ -£0)) (6.64) 
A A A A 
f a) f a) 
= J xdx + c J dx 
f (0) f (0) 


Of course, if the function g4 is used in the formulas (6.63) and (6.64), instead of f4 
we then get similar equivalences; that is: 


8(0)+e 8 (0) 
A A 

dx = J dx (6.65) 
gMD+e 8a) 


A A 


§(0)+e 8 (0) 8 (0) 
A A A 


J dx = frate fax (6.66) 


8 (+e 8a) 8&0) 
A A A 


&(I)+e 8&0) 
A A 


J dx = fa (6.67) 


fete fo 
A A 


Using (6.60) and (6.62) we get 
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fare Ote fa )+c 
Are ~ FO -FO TO E PORU f0) Je 
fi O)+e A FO+e 
20) +e 8O)+e 8O)+e 
fe a kon | xdx 
g(0) — (1) g0) — gC) 
A A gDte A gW +c 
8(l)te 
+ J dx 
fote 
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(6.68) 


Now the equalities (6.63), (6.64), (6.65), (6.66), and (6.67) are applied to the above 


formula (6.68) and we obtain 


fo fo 70) fi 


r= a rare [ av = fe 
A+et FA) — £0) 7D —FO a 


A (0) fo A fO 
A 


f (1) 80) go) 
A 


fo 


C 
d. 
 f®O-fO) TO, [os OE = gd) mf g0 -80 =8(1) | 
A gi) 


m g0 &() 
i f 
-D-0 rare fa + fa 

A A g0) g0) fa 

a fO a go) 5 

fO =fO) 70, J- O70 Nar [a+ Oe) gl) ~ 
fo fo 

8) 8) 


dx 
ror oo |? + fae 


A ga) fa 


(6.69) 
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It follows directly from the equality (6.61) and the Definition 8 of the mandala factor 
that 


MF(A+ct)= f O+ r =f()+c+r=MF(A)+c 
A+c+t A+ct A i (6.70) 
if order A is positive 


and 
MF(A+c‘)= g O+ r =g(0)+c+r=MF(A)+c 
A+tct Ate A A (6.71) 


if order A is negative 


which proves the restricted additivity property. 


6.9.3 Homogeneity 


Proof of homogeneity (6.5) 
It follows directly from the mandala factor Definition 8 that 


f+ r if ordered A is positive 


= cA 
ae g (0) — r if ordered A is negative or) 
cA e 


whereas 
fa FO fo 
cA ror | -7070 j * 
cA fo cA fo 
a g e (6.73) 
(0) (0) (d) 
g0 & 8 £ 
= d d 
gO = J e ame i 
cA a gO ga) 


A 


for A such that f # const oraz g € const and c #0 and r = 0 dla c = Q. It results 
A A 


A 
from operations on OFNs that for Ja 
se 


f@= = cat) 
266) = = cx g0) 


cA 


(6.74) 
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Formulas (6.72), (6.74), and (6.56) imply that for any homogeneity it is sufficient to 


indicate the following equality 


r=cr 
cA A 
First, we note that 
fw fo 
J ax =e(f@-f0) =e f ax 
A A 
FO fo 
and 
cfo fo 
A 1 2 2 A 
J xdx = seko) — (o) )- g J xdx 
2 A A 
fO fo 


(6.75) 


(6.76) 


(6.77) 


Obviously, use of the function g instead of f in the above formulas and results in 
A A 


analogous equalities; that is: 


8(0) 8 (0) 
cA A 
+ dx =c J dx 
8a) 8ga) 
cA A 
8&0) go) 
cA A 
J dx= Í xdx 
gC) 8a) 
cA A 
F469) 8d) 
cA 
dx=c dx 
fo fo 
cA A 


(6.78) 


(6.79) 


(6.80) 


It follows directly from z (6.73) and (6.74) that for dla A such that f 4 const and 
A 


g # const and c #0 
A 
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1 he cf (0) > 
A 
r= —— xdx dx 
c (œ -10) jo (ren -f0)) gf 
á (6.81) 
cg(0) cgo) cga) 
c g(0) A I A A 
a dx xdx + I dx 


c (z0 = g0) cg) C (z0 = g0 )eġo cfo 
A A A A A A J 


As can be easily seen, using (6.76), (6.77), (6.78), (6.79), and (6.80) we get (6.75) 


r=cr. 
cA A 
namely, 
fd) fa g0) 
1 z fO A g0) A 
r ——— ~ e | -aem e [ a+ tc dx 
cA ? f(D) -f0 g0- u 
ci fC) — f0) fO A A fO A A 8a) 
A A A A A 
&(0) 8&1) 
1 s i 
--— s à fite / dx 
e(g0-s0) gD fa 
A A A A 
fd) fd) g(0) g(0) ga) 
‘A fO a g0) A A A 
0 e a rE a r | ef 
c: xdx dx + dx dx + dx 
fC) -f0 f(D) —fO) g(0) — g(1) g(0) — 80) 
A A fO A A fO A A 80) A A gil) f (1) 
A A A A A 
=r 
A 
(6.82) 
Therefore 


MF(A) =f O+ r =c fO +e: = (ro +1) ONE eax 


if order A is positive 


and 


MF(cA) = g0) + r =c: 80) +c: r= ehs% +r) Me! eas 


if order A is negative 


which ends the proof of the restricted homogeneity property. 
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Fig. 6.8 Number 
A[1, 2, 3, 4] positive 


| =i] 


oriented iai 
a} 
T 08 i wi jee 
= H Cite 
= H Nilo 
jy 0s i Qile 
0.2} H Uiig 
: $118 
i Oi le 
0 (i $ 
FOM LOM 3 
05 1 15 2 25 3 35 4 45 
x 
Fig. 6.9 Number — 4,3, 2,1] 
A [4, 3, 2, 1] negative 
oriented a 
1 
T 08 y hie 
= fe fi 
= Oj iN 
I 26} p iQ 
> is 
em is 
04 3|: 
Giin 
ojia 
02 Siig 
iio 
a1 iO 
0 H i 
LOM 2 FOM 
05 1 15 2 25 3 35 4 45 
x 


6.10 Catalogue of the Shapes of Numbers in OFN Notation 


Figures 6.8 to 6.31 constitute the catalogue of basic shapes of numbers in OFN 
notation including the results of defuzzifications using several methods (Figs. 6.8, 
6.9, 6.10, 6.11, 6.12, 6.13, 6.14, 6,15, 6.16, 6.17, 6.18, 6.19, 6.20, 6.21, 6.22, 6.23, 
6.24, 6.25, 6.26, 6.27, 6.28, 6.29, 6.30 and 6.31). 
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Fig. 6.13 Number 
C’[3, 2, 2, 1] negative 
oriented 


Fig. 6.14 Number 
D[5, 5, 5, 6] positive 
oriented 


Fig. 6.15 Number 
D’[6, 5, 5, 5] negative 
oriented 
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Fig. 6.19 Number 
F’[0, —3, —1, —4] negative 
oriented 


Fig. 6.20 Number 
G[1, 2, 4, 3] positive 
oriented 


Fig. 6.21 Number 
G’[3, 4, 1, 2] negative 
oriented 
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Fig. 6.25 Number 
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Fig. 6.31 Number T ] T T =R 
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6.11 Conclusion 


The chapter presents two new original defuzzification methods: The golden ratio 
and mandala factor. Each is characterized by unique properties worthy to be noted. 
Real number values obtained through the operation of each operator are unique and 
different from those obtained using known methods. The golden ratio and mandala 
factor operation can therefore be applied in well-known and widely used arithmetics 
of fuzzy numbers such as L-R Dubois and Prade notation [20]. As shown in the 
calculations presented in the previous section the obtained results distinguish new 
operators from the classic, commonly known solutions. New operators are also char- 
acterized by the feature, which is absent in most of the classic operators. This feature 
is the sensitivity to order (order sensitive). This feature manifests so that different 
defuzzification values are obtained from one shape of a fuzzy number, depending 
on the fuzzy number order type (positive or negative) (Ordered Fuzzy Numbers). 
This is shown in the previous section. Basic shapes of the Ordered Fuzzy Numbers 
are visualized as shown in this chapter. To sum up, it can be concluded that both 
defuzzification methods, that is, the Golden ratio and mandala factor, meet all the 
criteria of defuzzification operators, and are adapted to applications in all fuzzy num- 
ber arithmetics, including Kosifski’s OFN arithmetic. After defuzzification of OFN 
numbers, one can trivially use relationship operators in order to make comparisons. 
This is an easy and intuitive method. It should be added that the defuzzification 
methods should be selected as a result of empirical research on a given category of 
data. 
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Chapter 7 
Two Approaches to Fuzzy Implication 


Magdalena Kacprzak and Bartłomiej Starosta 


Abstract We discuss construction of fuzzy implication and also correlation between 
negation and implication operators defined on fuzzy values. Two structures for fuzzy 
implications are studied: the lattice of Step-Ordered Fuzzy Numbers (SOFNs) and 
the Boolean algebra B of membership degrees for metasets. Even though these 
two approaches stem from completely different areas it turned out that they lead to 
similar applications and results. Both of them emerged from research conducted by 
W. Kosiński and can be applied not only in the most popular application field which 
is approximate reasoning but also for designing decision-support systems, enriching 
methods and techniques of opinion mining, or modeling fuzzy beliefs in multiagent 
systems. 


7.1 Introduction 


In his recent research Kosiński focused on new fields for applications of Ordered 
Fuzzy Numbers (OFNs) [24—26]. One of the promising domains was approximate 
reasoning involving fuzzy implication. Among the results of this development one has 
to mention Prokopowicz’s dissertation dealing with definition of engineering implica- 
tions. Another branch of this development, fuzzy implication on Step-Ordered Fuzzy 
Numbers (SOFNs), which emerged as the result of cooperation with Kacprzak, is 
presented in the following. At that time Kosiński, as the Starosta’s PhD supervisor, 
also took part in the development of metaset theory. The metaset concept is an alter- 
native approach to fuzzy membership, which has many interesting properties. Some 
of them are related to fuzzy implication and many-valued logics and are presented 
in the following. In this chapter we confront two approaches to fuzzy implication: 
OFN based and metaset based. 
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Fuzzy implication is an operation computing the fulfillment degree of a rule 
expressed by IF X THEN Y, where the antecedent and the consequent are fuzzy. 
These functions must comply with certain basic properties and the most typical is 
the Kleene-Dienes implication, based on the classical implication definition (x > 
y=-x V y), using the Zadeh negation and the maximum S-norm, but other fuzzy 
implication functions exist. On the other hand, fuzzy implication is an extension of 
the classical implication operator in which the two values involved and the result 
are not necessarily true or false (1 or 0), but can belong to the set [0,1]. Thus, it is a 
function f : [0, 1] > [0, 1]. 

Kosiniski’s effort was aimed at proposing an implication operation on OFNs anal- 
ogous to classical implication, which preserves its main properties. One of them says 
that for any two formulas a and (3, formula if a then £, that is, a > 8 is equivalent 
to formula ~a v 3. We want to obtain a similar equality for OFNs. The problem is 
with operation of negation. Because the set of all OFNs is not a complete lattice, 
the way of defining the implication is not straightforward. In 2011 Kacprzak and 
Kosiński proposed a new binary operator on the set VW called 2K-fuzzy implication 
that satisfies conditions of fuzzy implication, classically formulated in the theory of 
fuzzy sets [6] for two-value operations on a complete lattice (in the particular case on 
the interval [0, 1]) requiring it to be decreasing with respect to the first variable and 
increasing with respect to the second variable. It is an open question how to define 
negation and implication on the set of all OFNs 2. 

During fruitful discussions with Kosiński it turned out that metaset theory has all 
the capabilities necessary for defining fuzzy implication as well as for its applica- 
tions. Metasets admit partial membership of its members. Consequently, they allow 
formalization of properties satisfied with degrees other than complete truth or fal- 
sity. Metaset sentences express vague properties and they are evaluated in a Boolean 
algebra. Therefore, defining implication on their certainty values is straightforward. 
As opposed to the original Kosiński idea based on OFNs, the implication developed 
for metasets operates on crisp values, not fuzzy ones. Collection of all these values, 
however, forms a structure (the Boolean algebra) that enables expressing imprecision 
with the help of sentences of the metaset language. 

In this chapter we examine two approaches. Therefore, it is divided into two 
main sections: Sect.7.2 summarizes Step-Ordered Fuzzy Numbers and gives the 
construction of fuzzy implications defined on these numbers; next, Sect. 7.3 discusses 
the Boolean algebra of membership degrees for metasets and introduces metaset- 
based implication. Finally, in Sect.7.4 we provide a summary of both approaches 
and outline directions for future research. 


7.2 Lattice Structure and Implications on SOFNs 


Orthodox Ordered Fuzzy Number A is defined as an ordered pair of continuous real 
functions specified on the interval [0, 1]; that is, 


A= (f, g) 
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with 
f,g:[0,1] > R. 


In this chapter, the set of all OFNs is denoted by &. The continuity of both func- 
tions implies that their images are bounded intervals, say UP and DOWN, respec- 
tively. The following symbols are used to mark boundaries for UP = [l4, 1, ] and 
for DOWN = OŠ, pa]. If we further assume that f and g are monotone Gad con- 
sequently invertible), and add the constant function on the interval [1, , 1$] with its 
value equal to 1, we might define the membership function 


Hup(x) if x € Ta, 14] = (FO), f], 
HQ) = į Hdown(X) if xe tim [g(1), g(O)], (7.1) 
1 if xe[1j, 17]. 


where 


1. [Lup (Xx) =: f! (x) and Hdoun (X) =: g'(x). 
2. f is increasing; g is decreasing. 
3. f < g (pointwise). 


Obtained in this way the membership function u(x), x € R represents a mathematical 
object that refers to a convex fuzzy number in the classical sense [10, 34]. However, 
we can observe here some limitations. This is because some membership functions 
already known in the classical theory of fuzzy numbers (cf. [10, 18, 46]) cannot be 
obtained by taking inverses of continuous functions f and g in the process described 
above. These are the functions that are piecewise constant; that is, Hup and Hdown are 
not strictly monotone. The lack of strict monotonicity implies that functions inverse 
tO Hup and Hdown do not exist in the classical sense. To cope with this problem Kosiński 
offered to accept some limitations assuming that for both functions Hup and gown 
there exist a finite (or at most countable) number of such constancy subintervals, and 
then the inverse functions are piecewise continuous and monotone with a finite (or 
at most countable) number of discontinuity points [36]. In this way we can employ 
a class of functions larger than continuous ones. This is the class of real-valued 
functions of bounded (finite) variation, BV [41]. 


7.2.1 Step-Ordered Fuzzy Numbers 


In 2006 Kosiński introduced a generalization of the original definition of OFNs to 
make the algebra a more efficient tool in dealing with imprecise, fuzzy quantitative 
terms [36]. 


Definition 1 By an OFN A (in the generalized form) we mean an ordered pair (f, g) 
of functions such that f, g : [0, 1] —> R are of bounded variation, that is, f, g € BV. 
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Let Zgy denote the set of all generalized OFNs, that is, those that meet 
Definition 1. Notice that all convex fuzzy numbers are contained in this new space, 
& C Ky. Operations for generalized OFNs are defined in a similar way to oper- 
ations for orthodox OFNs, the norm, however, will change into the norm of the 
Cartesian product of the space of functions of bounded variations. 

An important consequence of this generalization is the possibility of introducing a 
subspace of an OFN composed of pairs of step functions [37]. First, a natural number 
K is fixed and [0, 1) is split into K — 1 subintervals [a;, a; ); that is, 


K-1 


(Jai, ai1) = [0, 1), 


i=l 


where 
O=a, <a <- <açp=l. 


Now, define a step function f of resolution K by putting value u; € R on each 
subinterval [a;, a;+1). Each such function f is identified with a K-dimensional vector; 
that is, 

f ~u= (uy, W,..., ux) € RX, 


where the Kth value ux corresponds to y = 1; that is, f(1) = ux. Taking a pair of 
such functions we have an OFN from gy. 


Definition 2 By a Step-Ordered Fuzzy Number A of resolution K we mean an 
ordered pair (f, g) of functions such that f, g : [0, 1]—R are step functions of reso- 
lution K. 


We use Zx for denotation of the set of elements satisfying the above definition. 
The example of an SOFN (also called Step Kosirtiski’s fuzzy number, SKFN) and its 
membership relation (represented by a curve) are shown in Figs. 7.1 and 7.2. The set 
Zg C #py has been extensively elaborated in [22, 35]. 

We can identify Æg with the Cartesian product of R“ x R* because each K-step 
function is represented by its K values. It is obvious that each element of the space 
Zg may be regarded as an approximation of elements from gy; by increasing 
the number K of steps we are getting a better approximation. The norm of &x is 
assumed to be the Euclidean one of R2*, thus we have an inner-product structure at 
our disposal. 

Now let Z be the set of two binary values: 0, 1 and let us introduce the particular 
subset V of Bx 


N = {A = (u, v) E Zg : ue BË ve BY}. (1.2) 


It means that each such component of the vector u as well as of v has value 1 or 0. 
Because each element of M is represented by a 2K-dimensional binary vector the 
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002040608 1 ” 002040608 1 Y 
Fig. 7.1 Example of a Step-Ordered Fuzzy Number A = (f, g) € Zg, a function f, b function g 


Fig. 7.2 Membership 


y 
relation of the Step-Ordered 
Fuzzy Number 1 
A = (f, g) € Zg depicted in 
Fig.7.1 0,8 
0,6 
0,4 
0,2 
0 


cardinality of the set. is 27*. The set “W consists of all binary SOFN, also called 
Binary Step Kosirtiski’s Fuzzy Numbers (BSKEN). 


Definition 3 By a BSKFN A of resolution K we mean an ordered pair (f, g) of 
functions such that f, g : [0, || Z are step functions of resolution K. 


7.2.2 Lattice on Zk 


Let us consider the set Zg of SOFNs with operations 
AAB=:F and AVB=:G 


defined for each two fuzzy numbers A = (f4, ga), B = (fp, ga) by the relations: 
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F = (fr, gr), if fr = suptfa, fa}. gr = SUp{8A, 8B} , (7.3) 
F = (ff, gr), if fe = inf{fa, fe} , gr = inf{ga, ga}. (7.4) 


Notice that V and ^ are actually operations in Zx; that is, they are defined for all A, 
B € Zx and the result of the operations is in Zg. Next, let us observe that operation 
V is 


e Idempotent: Whenever it is applied to two equal values, it gives that value as the 
result: 
A V A= (sup{fa, fa}, sup{8a, 8a}) = (fa, 8a) =A, 


e Commutative: 


A V B= (sup{fa, fe}, sup{ga, 8a}) = (suptfe. fal, suptgp, ga}) = BV A, 


e Associative: 


(AV B) v C = (suptfa, fs}, sup{ga, gB}) VC = 


(sup{fa, fe. fc}, suptga, 8B, 8c}) =A V (sup{fe, fc}, supl gs, 8c}) = 
AV (BV C). 


The same properties characterize the operation A. Moreover, these two operations 
are connected by the absorption law: 


AA (AV B) =A ^ (supifa, fa}, sup{8ga, 88}) = 
(inf {fa, suptfa, teh}, inf {ga, sup{Za, gB) = (fa, ga) =A 


and similarly for 
AV (AA B)=A. 


The absorption laws ensure that the set Zg with an order < defined as 
A<B iff B=AvVB (7.5) 


is a partial order within which meets and joins are given through the operations V and 
A. It is easy to show that for every A, B € Zx it holds that A v B = Biff B — A > 0. 
Moreover, joints and meets exist for every two elements of 2. The following theorem 
is the consequence of the above reasoning. 


Theorem 1 The algebra (Zg, V, A) is a lattice. 
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7.2.3 Complements and Negation on N 


Now let us consider the subset .V of Zx defined in Sect.7.2.1. As we have already 
noted above, every element of .% can be represented by a binary vector and thereby 
VW is isomorphic to the space of Boolean vectors. Below, we use the notation 
Alaa...) for a number A represented by vector (a), d2,..., azg) and we show 
that .V is a Boolean algebra. 

It is easy to observe that all subsets of ./ have both a join and a meet in ⁄⁄. In 
fact, for every pair of numbers from the set {0, 1} we can determine max and min and 
it is always 0 or 1. Therefore .V creates a complete lattice. In such a lattice we can 
distinguish the greatest element 1 = A(,,;,_..1) and the least element 0 = A ,0,...,0)- 


Theorem 2 The algebra (N,V, A) is a complete lattice. 


In a lattice in which the greatest and the least elements exist it is possible to define 
complements. We say that two elements A and B are complements of each other if 
and only if 

AVB=1 and AAB=0. 


The complement of a number A is marked with —A and is defined as follows. 


ax) EM be a SOFN. Then the complement of 


A (aya gaudy aK) 7 Ada ta ess 1—anx)- 


A bounded lattice for which every element has a complement is called a com- 
plemented lattice. The structure of Step-Ordered Fuzzy Numbers (.%, V, A) forms 
complete and complemented lattices in which complements are unique. In fact it is 
a Boolean algebra. An example of such an algebra is depicted in Fig.7.3. A set of 
universe is created by numbers 


N = [Aa maa 2.4 € {0,1} for i= 1,2,3,4}. 
The complements of elements are: 
=A 0,0,0,0) = Aa,1,1,)» 7A@,1,0,0) = Aq,0,1,1)» 7Aq,1,0,0) = 40,0,1,1ete.. 


Now we can rewrite the definition of the complement in terms of a new mapping. 


Definition 5 For any A € M we define its negation as 
N(A) := (1—a,,l—q@,...,l—a@x) for A= (a,,q@,...,@x). 


It is obvious, from Definitions 4 and 5, that the negation of a given number A is its 
complement. Moreover, the operator N is a strong negation, because it is involutive: 
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(1,1,1,1) 


(1,0,0,0) (0,1,0,0) (0,0,1,0) 


(0,0,0,0) 


Fig. 7.3 A complete and complemented lattice defined on the set ~ c R* 


N(N(A)) =A foran AEM. 


One can refer here to known facts from the theory of fuzzy implications (cf. 
[6, 7, 21]) and write the strong negation N in terms of the standard strong nega- 
tion N; on the unit interval J = [0, 1] defined by N;(x) = 1 — x,x € I, namely 
N((a1, a2, ..., a2x)) = ((Nr (a1), Nr(a2), ..., Nr(@2x)). 


7.2.4 Fuzzy Implication on BSOFN 


The implication operator holds center stage in the inference mechanisms of any logic. 
Thus, the obvious question is whether and how one can define an implication on an 
OFN. Studies on this issue were initiated in the works by Kacprzak and Kosiński in 
2011 [28, 38]. The aim was to propose an implication operation on Ordered Fuzzy 
Numbers analogous to classical implication that preserves its main properties. In 
the literature we can find several different definitions of fuzzy implications. Some 
of them are built from basic fuzzy logic connectives. In Sect. 7.2.2 conjunction and 
disjunction operations for any two-order fuzzy numbers are defined. However, the 
main problem is the negation operation. In Sect. 7.2.3 complements for SOFNs from 
the set .V are constructed. Thus given disjunction and complement, implication can 
be defined in the standard way. Such a new operator on the set.’ was introduced by 
Kacprzak and Kosinski and is called 2K-fuzzy implication [28, 29, 38]. The set of 
all OFNs is not a complete lattice, therefore the way of defining implication is still 
an open question. 

In the classical Zadeh fuzzy logic the definition of a fuzzy implication on an 
abstract lattice Y = (L, <z) is based on the notation from fuzzy set theory introduced 
in [21]. 
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Table 7.1 Examples of implications for SOFN 


A B A>B 

A(0,0,1,0) A(1,1,0,1) A(1,1,0,1) 
A(,0,1,0) A(1,0,0,0) A(1,1,0,1) 
A@,0,1,1) A(,0, 1.0) A(1,1,1,0) 
A(1,0,0,1) A@,1,0,0) A@,1,1,0) 
A(1,1,0,0) A(i,1,0,0) A(i,1,1,1) 
AQ1,1,1) A(1,0,0,0) A(1,0,0,0) 


Definition 6 Let Z = (L, <L, OL, 1z) be a complete lattice. A mapping J : L? > 
Lis called a fuzzy implication on -X if itis decreasing with respect to the first variable, 
increasing with respect to the second variable, and fulfills the border conditions 


I (0L, Or) = I (lz, It) = It, f (L, Or) = OL. (7.6) 


Now, possessing the lattice structure of 4 and the Boolean structure of our 
lattice .Y, we can repeat most of the definitions known in Zadeh’s fuzzy set theory. 
The first one is the Kleene-Dienes operation, called 2K-fuzzy implication [28] 


J (A, B) = N(A) VB, forany ABEM. (7.7) 


In other words, the result of the binary implication .4,(A, B), denoted in [28] by A > 
B, is equal to the result of operation sup for the number B and the complement of A: 


A — B = sup{-A, B}. 
For illustration, let us assume two numbers A(0,1,1,0) and A(o,1,0,1)- The implication 


Ao,1,1,0) > A@,1,0,1) 


equals 
N(Ao,1,1,0)) VY A@,1,0,1) = Aq,0,0,1) VA@,1,0,1) = 4,1,0,1)- 


Examples of other implications are given in Table 7.1. 
2K-fuzzy implication satisfies the basic property of logical implication: it returns 
false if and only if the first term is true, and the second term is false. 


Proposition 1 Let us consider the Boolean algebra (NV ,V, A, =, 1, 0). The values 
of the 2K -fuzzy implication on the greatest and the least elements of this algebra are 
given in Table 7.2. 


In fact, because — 0 = 1 and — 1 = 0 it holds that: 


°©030=N(0)VO=1V0=1. 
e 0>1=N@O)vl=1v1=1. 
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Table 7.2 Table of values of implications for the least element and the greatest elements of .” 


A B A>B 
0 0 1 
0 1 1 
1 0 0 
1 1 1 
el—-0=NQ)V0=0V0=0. 
ele 1Ll=NOVILI=O0VI=1 
Next we may introduce the Zadeh implication by 
47(A, B) = (A A B) v N(A), foranyA,Be MN. (7.8) 


In our lattice Zx the arithmetic operations are well defined, therefore we may intro- 
duce the counterpart of the Łukasiewicz implication by 


I, (A, B) = C, where C = 1^ (1 —A +B). (7.9) 


When calculating the right-hand side of (7.9) we have to regard all numbers as 
elements of Zg, because by adding step fuzzy number A from .¥% to the crisp 
number | we may leave the subset.” C Zg. However, the operation A takes us back 
to the lattice .%. It is obvious that in our notation 1y = 1. The explicit calculation 
is:if C = (ci, Cipres c2K)), Å = (ai, Ulysse ax), B = (bi, bo, EET box), then c; = 
min{1, 1 — a; + bi}, where 1 <i < 2K. 

It is obvious that all implications .%, %, and A; satisfy the border conditions 
(7.6) as well as the fourth condition of the classical binary implication, namely 
I (Oy, ly) = 1y. 


7.2.5 Applications 


Initially, OFNs were designed to deal with optimization problems when data are 
fuzzy [14, 15, 17, 20]. When Kacprzak and Kosiński observed that a subspace of 
OFNs, called SOFN, may be equipped with a lattice structure, it turned out that OFNs 
have a much wider field of application. The ability to define Boolean operations such 
as conjunction, disjunction, and, more important, diverse types of implications, has 
become the basis for creating a new logical system. In consequence, it turned out 
that SOFNs can be used not only for evaluation of linguistic statements such as, 
“A patient is fat” or “A car is fast,’ but also for approximate reasoning on such 
imprecise notions. 

One of the important applications is employing SOFNs in multiagent systems 
for modeling agents’ beliefs about fuzzy expressions [27]. This can be helpful in 
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evaluating features of multiagent systems concerning agents’ fuzzy beliefs. If some 
sentence is expressed by an agent in a multiagent system then we could try to evaluate 
the level of truth for an agent’s belief about another agent’s belief. This is the first 
step in the application of the fuzzy logic that stands behind the SOFN. 

Just before his death, Kosiński with his coworkers Kacprzak and Wegrzyn-Wolska 
showed another application of SOFNs in specification and automatic verification of 
diversity of opinion [30]. As a consequence, SOFN can also be used in reasoning 
about communicating software agents or boots that are decision-support systems. For 
example, we can analyze activity of agents that assists clients with their decisions 
in e-shops, that is, agents which support users of a system in making decisions and 
choosing the right product. 


7.3 Metasets 


The metaset is the new concept of a set with a partial membership relation. It was 
inspired by the method of forcing [1 1, 47] in the classical Zermelo-Fraenkel set theory 
(ZFC) [23, 39]. Nonetheless it is directed towards artificial intelligence applications 
and efficient computer implementations. Its scope of practical usage is similar to 
fuzzy sets [57], intuitionistic fuzzy sets [5], or rough sets [45]. There are close 
relationships between fuzzy set and metaset approaches, described in [50, 55]. 

Metasets admit standard set-theoretic relations that are valued in a nontrivial 
Boolean algebra, and therefore enable expressing fractional degrees of membership, 
equality, subset, and their negations. Algebraic operations for metasets are defined 
and they satisfy Boolean algebra axioms [54]. 

Metasets enable the representation and processing of vague imprecise notions 
and data. Recent development in applications of metasets is focused on decision 
systems [31-33]. There have been successful attempts to utilize metasets in character 
recognition problems [49, 51]. 

Before we discuss the definition of a metaset we review some necessary basic 
notions and establish a notation. 


7.3.1 The Binary Tree T and the Boolean Algebra 8 


The binary tree T is the set of all finite binary sequences, that is, functions whose 
domains are finite ordinals, valued in 2 (w is the set of all finite ordinals)!: 


T= gz. (7.10) 


new 


lFor n € w, let 2” = { f: nt 2} denote the set of all functions with the domain n and the range 
2 = {0, 1}; they are binary sequences of the length n. 


144 M. Kacprzak and B. Starosta 


Fig. 7.4 The levels To-T2 1 
of the binary tree T and the oa a 
ordering of nodes. Arrows 
point at the larger element [o] [1] 
[00] [01] [10] [11] 


The ordering < in the tree T (see Fig. 7.4) is the reverse inclusion of functions: for 
p,q € T such that p: nt» 2 and q: m > 2, we have p < q whenever p > q; that is, 
n > mand pim = q. The root 1, being the empty function, is the largest element of 
T in this ordering. 

Nodes of T are sometimes called conditions. We denote binary sequences that are 
elements of T using square brackets, for example: [00], [101]. A level in T is the 
set of all finite binary sequences with the same length. The set 2” consisting of all 
sequences of the same length n is the level n, denoted by T,,. The level 0 consists of 
the empty sequence 1 only. A branch C in T is an infinite binary sequence, that is, a 
function w +» 2. We write p € C to mark that the binary sequence p € T is a prefix 
of the branch C. 

For the given p € T the set of all infinite branches containing p determines a closed- 
open set p = { C € 2”: p € C} in the Cantor space 2”. The family of all such sets is 
the closed-open topological basis of this space. Because every clopen set is regular 
open? and the family of regular open sets of any topological space forms a complete 
Boolean algebra, we get the complete algebra B of clopen sets in 2”. The operations 
of join, meet, and complement correspond to standard set-theoretic operations in this 
case: union, intersection, and complement. Top and bottom elements are 2” and Ø, 
respectively. 

We use the algebra % to evaluate metaset sentences, particularly to evaluate mem- 
bership degrees. 


7.3.2 General Definition of Metaset 


A metaset is a classical set with a specific structure coding membership degrees of 
metaset members. The degrees, by construction, are expressed as nodes of the tree 
T but they represent elements of the algebra %. 


Definition 7 A set that is either the empty set Ø or has the form: 
T = { (o, p) : o isa metaset, p € T} 


is called a metaset. 


2A subset of a space X is regular open if it equals the interior of its closure. 
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Thus the structure we use to encode the degrees of membership is based on ordered 
pairs. The first element of each pair is the member and the second element is a node 
of the binary tree that contributes to the membership degree of the first element. 

Formally, this is a definition by induction on the well-founded relation €. By the 
axiom of foundation in Zermelo-Fraenkel set theory there are no infinite branches 
in the recursion as well as there are no cycles. Therefore, no metaset is a member of 
itself. From the point of view of ZFC a metaset is a particular case of a P-name (see 
also [39, Chap. VII, Sect. 2] for justification of such type of definition). 

For the given metaset 7, the sets: 


dom(r) = {o: Iper (o,p) eT}, (7.11) 
ran(T) = {p: doedom(r) (O, p) € T} (7.12) 


are called the domain and the range of the metaset 7, respectively. 


7.3.3 Interpretations of Metasets 


An interpretation of a metaset is a classical crisp set. It is produced from the given 
metaset with a branch of the binary tree. Different branches determine different 
interpretations of the given metaset. All of them taken together make up a collection 
of sets with specific internal dependencies, which represents the source metaset by 
means of its crisp views. 

Properties of sets that are interpretations of the given metaset determine the prop- 
erties of the metaset itself. In particular we use interpretations to define set-theoretic 
relations for metasets. 


Definition 8 Let 7 be a metaset and let C C T be a branch. The set 
Tc = {oc: (0,p)ETAPEC} 


is called the interpretation of the metaset 7 given by the branch C. 


The process of producing an interpretation of a metaset consists of two stages, 
repeated recursively. In the first stage we remove all the ordered pairs whose second 
elements are nodes that do not belong to the branch C. The second stage replaces the 
remaining pairs — whose second elements lie on the branch C — with interpretations 
of first elements. As the result we obtain a classical set. 


Example 1 Let p € T and let T = { (Ø, p) }. If C is a branch, then 


pEC > Tc={9}, 
pgC>r=ð. 
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Depending on the branch the metaset 7 acquires one of two different interpretations: 
{Ø } or Ø. Note that dom(r) = {Ø }. 


AS we see, a metaset may have multiple different interpretations: each branch in 
the tree determines one of them. Usually, most of them are pairwise equal, thus the 
number of different interpretations is much less than the number of branches. 


7.3.4 Forcing 


We define and investigate a relation between a condition and a sentence. This rela- 
tion, called the forcing relation, is designed to describe the level of confidence or 
certainty assigned to the sentence. The level is evaluated by means of conditions in 
T that determine elements of the Boolean algebra B. The root condition 1 specifies 
the absolute certainty, whereas its descendants represent less certain degrees. The 
sentences are classical set theory formulas, where free variables are substituted by 
metasets and bound variables range over the class of metasets. 

Given a branch C, we may substitute particular metasets in the sample sentence 
o € T with their interpretations that are ordinary sets: oc € Tc. The resulting sentence 
is a ZFC sentence expressing some property of the sets Tc and oc, the membership 
relation in this case. Such a sentence may be either true or false, depending on Tc 
and oc. 

For the given metaset 7 each condition p € T specifies a family of interpretations 
of 7: they are determined by all the branches C containing this particular condition p. 
If for each such branch the resulting sentence (after substituting metasets with their 
interpretations) has constant logical value, then we may think of a conditional truth 
or falsity of the given sentence, which is qualified by the condition p. Therefore, we 
may consider p as the certainty degree for the sentence. 

Let ® be a formula built using the following symbols: variables (x!, x”, ...), the 
constant symbol (Ø), the relational symbols (€, =, C), logical connectives (A, V, 
4, —>), quantifiers (Y, 3), and parentheses. If we substitute each free variable x! 
(i= 1...n) with some metaset v’, and restrict the range of each quantifier to the 
class of metasets WM, then we get as the result the sentence (v',..., v”) of the 
metaset language that states some property of the metasets v!,..., v”. It is called a 
metaset sentence. By the interpretation of this sentence, determined by the branch C, 
we understand the sentence ® (vb, ..., VÈ) denoted in brief by Sc. The sentence Sc 
is the result of substituting free variables of the formula ® with the interpretations 
vi. of the metasets v’, and restricting the range of bound variables to the universe 
of all sets V. In other words, we replace the metasets in the sentence ® with their 
interpretations. The only admissible constant Ø in ® as well as in c denotes the 
empty set which is the same set in both cases. 


Definition 9 Letx!, x”, ...x" all be free variables of the formula ® and let v!, ...v” 
be metasets. We say that the condition p € T forces the sentence @(v',v*,...v"), 
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whenever for each branch C C T containing p, the sentence ® (v4, .. . v%) is true. 
We denote the forcing relation with I+. Thus, 


pit d(v',...v") iff Veer (C is a branch ApEC > Pwt, 22) : 


The key idea behind the forcing relation lies in transferring classical properties 
from sets onto metasets. Let a property described by a formula ® (x) be satisfied by 
all sets of form vc, where v is a metaset and C is a branch in T. In other words, ® (vc) 
holds for all the sets that are interpretations of the metaset v given by all branches 
C in T. Then we might suppose that this property also “holds” for the metaset v, 
and we formulate this fact by saying that 1 forces ®(v). If (vc) holds only for 
branches C containing some condition p, then we might suppose that it “holds to 
the degree p” for the metaset v, we say that p forces ® (v) in such a case. Because 
we try to transfer, or force, satisfiability of some property from classical sets onto 
metasets, we call this mechanism forcing.’ The next example shows how to transfer 
the property of being equal onto two specific metasets. 


Example 2 Lett = { (Ø, p) y and o = { (Ø, p - 0) , (Ø, p - 1) }, where p € T and p- 0, 
p- 1 denote its children. Let C be a branch. 


p-0EC > Tc={O} A oc = {GB} > TC =O, 
plec = T={O} A oc ={GB} > To=0c, 
pgc > T=OAoc=D > T=. 


Of course, the last case is possible only when p ¥ 1, because the root of T is contained 
in each branch. As we can see, the interpretations of 7 and ø are always pairwise 
equal, although they are different sets depending on the chosen branch C. Analyzing 
only the structure of r and ø we may easily conclude that p IF T = ø. However, 
because for any branch C that does not contain p the interpretations of 7 and o are 
both empty, then also 1 |F 7 = ø. 


Thus, for the given metaset sentence ®, the set of all conditions that force it, 
{p € T: p | ®}, determines an element of the Boolean algebra B. We interpret it 
as the certainty degree for ® (cf. [55, 56]) 


Definition 10 Let ® be a metaset sentence. The following element of algebra % is 
called the certainty degree for ®. 


Io} = J{o E8: plo}, (7.13) 


where b, is the set of all branches containing p. 


In other words b, is the set of infinite binary sequences sharing the common prefix p. 


3This mechanism is similar to, and in fact was inspired by, the method of forcing in classical set 
theory [11, 12]. It has not much in common with the original, though. 
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7.3.5  Set-Theoretic Relations for Metasets 


We briefly sketch the methodology behind the definitions of standard set-theoretic 
relations for metasets. For a detailed discussion of the relations or their evaluation 
the reader is referred to [54, 55]. 


Definition 11 We say that the metaset o belongs to the metaset 7 under the condition 
p € T, whenever p l- o € r. We use the notation o £p T. 


In other words, o €, T whenever for each branch C containing p, it holds øc € Tc. 
Formally, we define an infinite number of membership relations: each p € T specifies 
another relation €,. Any two metasets may simultaneously be in multiple membership 
relations qualified by different conditions: o £p T A o €q T. Membership under the 
root condition 1 resembles the full unconditional membership of crisp sets, inasmuch 
as it is independent of interpretations. By the Definition 10, the membership degree 
of ø in 7T is |ø € T|. This degree encompasses all the p that force the membership; it 
is the union of elements of B corresponding to these p. 

The metaset membership admits a hesitancy degree known from the intuitionistic 
fuzzy sets’ field. It is possible that degrees of membership and nonmembership do 
not sum up to unity. The remaining part is called the hesitancy degree of membership 
(see [55, 56]). This property has important consequences mentioned in Sect. 7.3.7. 

Conditional equality and subset relations for metasets are defined similarly as for 
a membership. 


7.3.6 Applications of Metasets 


The conditional membership reflects the idea that a metaset u belongs to a metaset 
T whenever some conditions are fulfilled. The conditions are represented by nodes 
of T but they relate to elements of algebra S. In applications they refer to a modeled 
reality and denote some real conditions that justify the statement. Let js be some 
individual and let 7 be the family of those individuals who are nice: they satisfy the 
property of being nice. The sentence u £p T says that u is nice under the condition p, 
or, in other words, to the degree p. The condition p itself might be expressed using 
human language terms, for example: pretty face (thus a is nice because of pretty face). 
Labeling conditions with human language terms requires imposing partial ordering 
on these terms, which is generally rather subjective and not straightforward. We 
investigated such orderings in a series of papers discussing a new decision-support 
system based on this idea (see [3 1—33]). 


7.3.7 Classical and Fuzzy Implication 


We may easily define classical implication on the algebra % as follows. 
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b>cz=z-bUc, bce. (7.14) 


Clearly, it is a fuzzy implication. We may define other fuzzy implications on % too, 
however, from the point of view of metaset theory we are interested in those that 
satisfy the following. 

I| > |Y] = |S > Y|. (7.15) 


Here, @ and W are metaset sentences and |®|, |W| are their corresponding certainty 
degrees, which are members of 88. We would like the implication to commute with 
the forcing relation that determines certainty degrees for sentences. In other words, 
we want to have certainty degree of implication Ø —> W tobe equal to the implication 
of certainty degrees for sentences ® and W. 

Unfortunately, in the general case (7.15) does not hold. In other words, gener- 
ally =|| U|W| does not have to be equal |-® v W| and also the border condi- 
tion J (0z, 0L) = 1z of definition (6) might not be satisfied. The reason for this is 
metasets’ capability of expressing uncertainty. The value of |®| is the measure of 
certainty, that is, our knowledge about ®. However, in general, —|®| is not equal to 
the certainty degree of —@, but it is not less and it might also include the hesitancy 
degree of ®, just as in intuitionistic fuzzy sets. To exclude the uncertainty issues 
one has to limit the scope to the class of hereditarily finite metasets. A metaset o 
is hereditarily finite when it is a hereditarily finite set: ran(c) is finite and dom(c) 
consists of hereditarily finite metasets only. For such metasets uncertainty vanishes, 
=|| = |-@], and (7.15) holds (see [55]).° The class of hereditarily finite metasets 
includes metasets representable in machines and it is sufficient for applications. 
Investigating implication (7.14), which satisfies (7.15), is one of the next goals in the 
development of metaset theory and related logic of metaset sentences. 


7.4 Conclusions and Further Research 


The purpose of this chapter was to present new operators that satisfy the conditions 
for fuzzy implication in the classical sense [6]. These results emerged from the 
research conducted by Kosiński, undertaken in his last years of life. They were 
initiated by investigation of applications of Ordered Fuzzy Numbers, alternatively 
called Kosifiski’s fuzzy numbers. Even though the described approaches stem from 
completely different areas, it turned out that they lead to similar applications and 
results. Furthermore, they launched a new stream of research that has continued by 
his coworkers Kacprzak, Starosta, and Wegrzyn-Wolska after Kosiriski’s death. The 


4To prove this fact and consequently, that the equation (7.15) fails in general one has to use examples 
similar to the ones presented in [50]. 

>The assumption of finiteness of dom(c) may be dropped to obtain a broader class of finite deep- 
range metasets (see [55]) for which there is no uncertainty and (7.15) still holds. 
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applications of the research on OFNs and metasets concern not only approximate 
reasoning but also decision-support systems and opinion mining [31-33]. 

In this chapter we discussed two structures for fuzzy implication: the lattice of 
Step-Ordered Fuzzy Numbers and the Boolean algebra 8 of membership degrees 
for metasets. In both of them a fuzzy implication operator (FI) is defined. The impli- 
cation operator holds center stage in the inference mechanisms of any logic. We can 
find several different definitions of fuzzy implications in the literature. They play a 
similar role to Boolean implications that are employed in inference schemes such as 
modus ponens and modus tollens. However, now reasoning is done with fuzzy state- 
ments whose truth values lie in [0, 1] instead of {0, 1}. The most exploited area of 
applications of fuzzy implications is approximate reasoning, wherein from imprecise 
inputs and fuzzy premises or rules we can obtain imprecise conclusions. 

In the the first part of the chapter the binary Step-Ordered Fuzzy Numbers are 
explored. As mentioned earlier, Kosiński was looking for new inference schemas and 
thereby implications based on the orthodox Ordered Fuzzy Numbers (f, g), where 
functions f and g are assumed to be continuous. This question still remains unan- 
swered and studies are in progress. The biggest challenge was to define a negation 
operator. During the research Kacprzak and Kosiński observed that BSOFN (f, g), 
in which functions f and g are step functions that can return binary values 1 or 0, 
form a lattice. This property allows us to define the fuzzy implications similar to 
those proposed by Kleene-Dienes, Zadeh, or Lukasiewicz. 

The second part of the chapter focuses on the results obtained by Starosta and 
Kosiński in the field of metasets. In the algebra 8 we can also define some fuzzy 
implication operators analogous to those from classical fuzzy set theory. However, 
the most important property that we are interested in is the equality of the certainty 
degree of the sentence Ø — W and the result of applying the operator = to the 
certainty degrees of sentences ® and W. Unfortunately, in the general case, this 
equality does not hold. Only when we make certain restrictions and limit the scope 
to the class of hereditarily finite metasets, we get the desired behavior of the operator. 

We dedicate future research on fuzzy implications aimed at developing theories 
and searching for the answers to the questions that are still open to the memory of 
Professor Kosiński. 
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Part II 
Examples of Applications 


Chapter 8 
OFN Capital Budgeting Under Uncertainty 
and Risk 


Anna Chwastyk and Iwona Pisz 


Abstract The aim of this chapter is to propose a new approach to incorporating 
uncertainty into capital budgeting. The chapter presents methods that can be used by 
an investor when the decision maker wants to be able to make an investment decision 
where there are alternative investment projects. This kind of problem is undertaken 
under the conditions of uncertainty and risk using Ordered Fuzzy Numbers (OFN). 
The starting point is the concept of Ordered Fuzzy Numbers. The chapter illustrates 
the implementation of the proposed approach with an example where two alternative 
investment projects are analyzed. The authors present the capital budgeting problem 
using a numerical example. The described methods dedicated to investment project 
selection lay the foundations for a fuzzy decision-making system. We utilize com- 
puter software such as MATLAB to demonstrate how the proposed methods can be 
applied to assessing the profitability of alternative investment projects. 


8.1 Introduction 


The capital budgeting problem is concerned with allocation of an organization’s 
capital to a suitable combination of projects (alternative projects) that can bring 
maximal profit to the organization [12]. In the literature we can find a variety of 
methods used in capital budgeting (see, e.g., [1, 2, 6, 22]). The main methods are: 
the net present value method (NPV), profitability index (PI), and internal rate of 
return (IRR). Based on the literature review we can state that the classical forms of 
these methods do not take into account the uncertainty and risk which may be inherent 
in the information used in them. This information includes future cash inflows, cash 
outflows and available investment capital, the required rate of return of the investment 
or cost of capital, and the duration of the project [21]. 
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Traditionally, these investment parameters are assumed as a crisp value. As we 
know, the capital budgeting problem is accompanied by uncertainty and risk, which, 
in general, stem from the lack of access to certain data (imprecise data) [11, 21]. In 
practice, this involves, above all, the inability to predict the behavior of the market 
during the timeframe of the project’s execution, including weather conditions, the 
level of prices and costs, availability of resources, exchange rates, interest rates, 
behavior of competition, changes in the demand/supply level for a given product or 
service, and so on. Therefore several authors began to use fuzzy set theory to help 
solve the capital budgeting problem in a fuzzy environment. In the literature we can 
find another approach to capital budgeting, that is, fuzzy capital budgeting. Several 
authors studied fuzzy set theory and its application in capital budgeting [3, 5, 7, 11, 
13, 14, 21]. Some authors indicated certain problems to solve the capital budgeting 
problem with fuzzy numbers [3, 5, 6, 21]. 

The notion of Ordered Fuzzy Numbers (OFN) was proposed by Kosiński, 
Prokopowicz and Slezak, [20] to eliminate several drawbacks of classical convex 
fuzzy numbers (CFN) such as the loss of precision increasing with the number of 
performed operations and the fact that even linear equations cannot be solved in the 
set of fuzzy numbers. A new fuzzy number does not require any existence of a mem- 
bership function and can be regarded as an extension of a parametric representation 
of a fuzzy number. 

Ordered Fuzzy Numbers were first used as a tool for a decision- support system 
concerning financial project evaluation in the paper [18] and the research was con- 
tinued in [8]. Their idea was based on the determination of the internal rate of return 
of an investment project in which all expenditures and income were imprecise and 
vague. 

In this chapter we present a capital budgeting problem using OFNs. We continue 
the research started in the article by [9], which concerned the use of the net present 
value method to estimate the attractiveness of an investment opportunity. We now 
modify the method presented in the previous paper by transferring the defuzzification 
process to another stage of calculations and present the next discount methods- 
profitability index and internal rate of return-to make an evaluation of alternative 
investment projects more precise. We can see that the described methods dedicated 
to the investment project selection problem lay the foundations for a fuzzy decision- 
making system. 

The chapter is organized as follows. In Sect. 8.2 we discuss the concept of fuzzy 
numbers and Ordered Fuzzy Numbers, which allow modeling using uncertain infor- 
mation. Section 8.3 is dedicated to the investment project’s estimation problem. It 
contains the main definitions of discounted values of cash flows, net present value 
method, profitability index, and internal rate of return. Section 8.4 presents the au- 
thors’ approach based on OFNs. In Sect. 8.5 we illustrate the issue on a computational 
example, demonstrating how the methods can be used for the capital budgeting prob- 
lem. We utilize a MATLAB environment to demonstrate how the proposed methods 
can be applied to assess the profitability of an alternative investment project. Final 
remarks and conclusions are contained in Sect. 8.6. 
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8.2 Ordered Fuzzy Numbers 


The introduction of the concepts of fuzzy sets and fuzzy numbers was propelled 
by the need to describe mathematically imprecise and ambiguous phenomena. The 
above concepts were described in the paper of Lotfi A. Zadeh [26] as a generalization 
of classical set theory. A fuzzy set A in a nonempty space X is a set of pairs A = 
{(x, Wa(x)); x € X}, where a(x) : X — [0, 1] is the membership function of a 
fuzzy set. This function assigns to each element x € X its membership degree to a 
fuzzy set. 

A fuzzy set, and hence its membership function, has two basic interpretations. 
It can be understood as a degree to which x possesses a certain feature, or as a 
probability with which a certain, and at this point not entirely known, value will 
assume a value x. 

A triangular fuzzy number is denoted with three real numbers [a, b, c], where 
a < b < c. Its membership function assumes the form: 


0 if x <a; 

4 if a<x<b; 
= b—a EnA 

M= harag 


0 if x>c. 


(8.1) 


If an expert generates a triangular fuzzy number as a result of assessing the 
distribution of possible values of a certain unknown quantity, it means that the expert 
deems the values below a, and above c, not possible; whereas the value b is possible 
with a degree of 1, and the remaining values are possible to a varying degree that 
decreases with their distance from b. 

The notion of OFN, defined by Kosiński, Prokopowicz, and Slezak, was intro- 
duced in order to eliminate postulated deficiencies of fuzzy numbers: the loss of 
precision increasing with the number of performed operations and the fact that even 
linear equations cannot be solved in the set of fuzzy numbers. The theorem formu- 
lated by Kosiński [17] concerning the universal approximation of any nonlinear and 
continuous defuzzification operator offers tools for the application of OFNs to fuzzy 
inference and modeling, including assessing the profitability of investment projects. 
Ordered Fuzzy Numbers give a precise and elegant framework for dealing with fuzzy 
objects (numbers) and many different methods of defuzzification. 


Definition 1 An Ordered Fuzzy Number A is an ordered pair (f, g) of continuous 
functions f, g : [0,1] > R. 


Graphically the curves of (f, g) and (g, f) do not differ. However, this pair of 
functions determines different OFNs; they vary in so-called orientation, which is 
denoted on diagrams by an arrow. 

Let A = (fa, ga), B = (fB, gp), and C = (fc, gc) be OFNs. Sum C = A+ 
B, product C = A- B, and division C = A ~ B are defined in the set of OFNs as 
follows. 
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fox) = fax) * fa(x) and gc(x) = ga (x) * 8g (x), (8.2) 
where “x” denotes “+”, “-”, and “=”, respectively. Moreover, A ~ B is only defined 
when f(x), ga(x) Æ 0 for each x € [0, 1]. In the set of OFN, subtraction, expo- 
nentiation, and taking a root can also be defined in the usual fashion, for example: 


(f g)” = (f", g”). (8.3) 


When considering the set of OFNs and the associated operations of addition 
and multiplication, we obtain a commutative ring with unity. By augmenting this 
with scalar multiplication, we obtain a linear space, that is, an algebra over real 
numbers. Moreover, this set constitutes a commutative Banach algebra with unity 
in the supremum norm in each of the factors C[0, 1] x C[0, 1] that are the Banach 
space. By introducing an appropriate relation of partial order, we also obtain a lattice 
[8]. We say that an OFN A = (f, g) is 


nonnegative if f(x) > 0 and g(x) > 0 for all x € [0, 1]; (8.4) 
positive if f(x) > 0 and g(x) > 0 for all x € [0, 1]. (8.5) 


Negative OFNs are defined in a similar way. 

Itis worthwhile to point out that the set of pairs of continuous functions, where one 
function is increasing and the other is decreasing, and, simultaneously, the increasing 
function always assumes values lower than the second function, is a subset of the set 
of OFNs, which represents the class of all convex fuzzy numbers with continuous 
membership functions [4, 10, 16, 23, 25]. 

Defuzzification is a process that converts a fuzzy set or a fuzzy number into a 
crisp value. Functionals, which map a fuzzy number to a real number, play a vital 
role in OFN applications. 


Definition 2 Let A be an OFN and c € R. A mapping ¢ from the space of all OFNs 
to the set of real numbers is called a defuzzification functional if it satisfies the 
following properties, 


1. d(c,c) =c, 

2. d(At+(c,c)) = ¢(A) +c, 

3. (cA) =c¢(A), 

4. @(A) = 0, if A is nonnegative (8.4) 


where (c, c) is a pair of constant functions on the interval [0, 1] representing the 
constant c. 


Therefore, a defuzzification functional must be homogeneous of order 1, as well 
as being restrictive, additive, and normalized. The model of constructing defuzzifi- 
cation functionals presented in [19] allows us to obtain a number of defuzzification 
functionals, whether linear or nonlinear. In this chapter we applied the nonlinear 
center of gravity defuzzification functional, defined by the following equations. 
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1 
SEON (9)—g(s))ds 
0 


1 

A , when f(f(s)— g(s))ds #0 

2 fF (s)—g(s))ds 0 

gcocohg= zy. ° (8.6) 

S fds 1 

— ; when | (f(s) — g(s))ds = 0. 
fads 0 


0 


8.3 Classic Capital Budgeting Methods 


In economic practice, net present value is the most commonly used discount method. 
In essence, this method consists in assessing the present value of an investment 
project based on the forecasted streams of net cash flows, which are the measure 
of an investor’s future benefits. NPV is defined as a sum of net cash flows (NCFs) 
discounted separately for each year and executed over the entire calculation period, 
with a constant level of interest (discount) rate. This value expresses the updated (on 
the day of the assessment) value of benefits, which the undertaking in question can 
yield in the future. The general form of NPV can be expressed as: 


n 


NPV=)> ——, (8.7) 


where n is the number of years, 
r is the market capitalization rate, 
and C F; is the cash flow in the ith year of investment. 


NPV allows making an investment decision having analyzed cash flows, reduced 
by a specific outlay, and discounted by a weighted average cost of capital. There- 
fore, NPV allows the assessment of the economic value of an undertaking. The em- 
ployment of a given method requires forecasting future cash flows, which involves 
forecasting several uncertain variables such as interest rate, prices of resources and 
services, and exchange rate. It affects the reliability and quality of forecasting future 
effects and outlay. NPV allows taking the time factor into account. If the net present 
value of an investment project is positive, the project will contribute to an increase 
in the value of the company and as a result the wealth of its owners. It is assumed 
that a given investment is profitable if the value of discounted cash flows during the 
completion of the investment is positive. 

The profitability index (PI), also known as the profit investment ratio (PIR) or 
value investment ratio (VIR), is the ratio of payoff to investment of a proposed 
project. It is a useful tool for ranking projects because it allows us to quantify the 
amount of value created per unit of investment. The profitability index is a ratio of 
discounted cash inflows to the discounted cash outflows: 


162 A. Chwastyk and I. Pisz 


P= (8.8) 


where n is the number of years, r is the market capitalization rate, C F* is the cash 
inflow in the ith year of investment, and C F; is the cash outflow in the ith year of 
investment. 

The PI helps in ranking investments and deciding the best investment that should 
be made. A PI greater than one indicates that the present value of future cash inflows 
from the investment is higher than the initial investment, thereby indicating that it will 
earn profits. A PI of less than one indicates loss from the investment, and a PI equal 
to one means that there are no profits. NPV and PI techniques in capital investment 
decisions are closely related to each other. The PI will be greater than 1 only when 
the NPV is positive. However, in the case of mutually exclusive proposals having 
different scales of investment, that is, where the initial investment in the alternative 
projects is not the same, a conflict in NPV and PI may occur. 

Another capital budgeting method is the IRR. This method is described as the 
discount rate r that equates the present value of the expected future net cash inflows 
with its initial outlay so we have N PV = 0. The IRR shows directly the rate of return 
on the examined projects. The project is cost-effective if its IRR is higher than the 
limit rate, which is the lowest rate of return acceptable to the investor. Generally, the 
higher the internal rate of return the investment project has the more profitable the 
project is [15]. Because of the general problem of finding the roots of the equation 
NPV = 0, there are many numerical methods that can be used to estimate the IRR. 

We use the method [24] consisting of several stages. First, we determine the 
value of the cash flows in subsequent years of an investment. Then, by successive 
approximations, we select two rates of return rı and rz satisfying the conditions: 


1. N PV; calculated for the rate rı is close to zero and positive. 
2. N P V, calculated on the basis of the rate rz is close to zero but negative. 


On the basis of these values we calculate the IRR of the considered project. We apply 
the following formula for this purpose. 


NPYV,(r2 — 11) 


IRR cyp E 
nt NPV, — NPV: 


(8.9) 


In the presented method of calculating the IRR, the difference between 7; and r3 is 
particularly important. With the increase in difference between rı and rz, calculation 
results become less and less accurate as compared to the actual IRR. In practice 
this difference should be less than one percentage point. In this case, the mistake in 
calculations of the IRR can be considered to be irrelevant. 


8 OFN Capital Budgeting Under Uncertainty and Risk 163 


8.4 Fuzzy Approach to the Discount Methods 


The classic forms of NPV, PI, and IRR do not take uncertain data into account. When 
considering the fuzzy environment of an investment project, modifying discount 
methods to take into account uncertain data becomes necessary. This allows us to 
take into consideration information uncertainty and decreases the risk of making a 
mistake in assessing the profitability of an investment project. 

For the problem of defining a generalization of the above-mentioned discount 
methods to OFNs, we assume that the capitalization rate R, cash flows CF, cash 
inflows C F, and cash outflows C F; are Ordered Fuzzy Numbers. The discounted 
cash flows in the ith year of investment are calculated as follows, 


CF; 


-c wl 
(1,1) +R)” ee 


where (1, 1) stands for a pair of constant functions that assume a value of one, and 
+ and + signify addition and division in a set of OFNs defined through the Eq. 8.2. 
Exponentiation is performed according to the formula 8.3. Therefore, we have the 
formula for ordered fuzzy net present value: 


n CF; 
OFNPV = —_——_. (8.11) 
2 (1,1) + Ri 
And for modified profitability index: 
n crt 
2 (A, D+)! 
OFPI =—_—__, (8.12) 
CF7 
2 (d, D+R)' 


Our modified method of calculating the internal rate of return requires selection 
of two ordered fuzzy rates of return R; and R3 satisfying the following conditions. 


1. OF NPY, calculated for the rate R; is close to ordered fuzzy zero (which means 
the pair of constant functions (0, 0)) and positive (see (8.5)). 
2. OFN PV, calculated for the rate R2 is close to ordered fuzzy zero and negative. 


On the basis of these values we calculate the ordered fuzzy internal rate of return of 
the considered project. We use the following formula for this aim, 


OFN PV,(R2 — Rj) 


OFIRR=R,+ 
OFNPV, — OF NPV, 


(8.13) 


Before presenting the results of the project evaluation to the investor, the selected 
defuzzification method should be applied in order to obtain real values: 
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NPV = ¢coc(OFNPV), PI = ¢coc(OFPI) 


and IRR = ¢cog(OFIRR). 


8.5 Computational Example of the Investment Project 


In this section we present an example of a capital budgeting problem using three 
methods based on OFNS. These methods are: ordered fuzzy net present value method 
(OFN PV), ordered fuzzy profitability index (O F PI), and ordered fuzzy internal 
rate of return (O FIRR). We consider an example of potential alternatives of in- 
vestment project execution: project one P; and project two P2. Investment decisions 
are made under the conditions of uncertainty and risk, inasmuch as it is impossi- 
ble to prepare an accurate description of economic and financial conditions for the 
functioning of the considered projects in the future. The use of OFNs allows us to 
limit the effects of uncertainty and risk. In order to define the fuzzy conditions of the 
execution of the investment project, the decision-making process involves an expert 
who has appropriate knowledge and experience in planning and executing similar 
projects. 

A major problem related to the use of OFNs was the requirement for the experts 
to give an opinion on individual elements of these alternatives of investment projects 
in the form of OFNs, that is, pairs of functions. We propose that the expert describe 
project parameters by means of triangular fuzzy numbers, which will be subsequently 
converted into OFNs. 

We assume that the considered projects are planned for the periods of 7 and 5 
years, respectively. The remaining project parameters remain uncertain, therefore 
they are determined by the expert in the form of triangular fuzzy numbers. The 
triangular fuzzy capitalization rate assumes the form of R = [0.04; 0.06; 0.07]. This 
means that according to the expert the capitalization rate of below 4% and above 7% 
is not possible, whereas the value of 6% is the most probable one, and other values 
are probable to a different degree: the higher they are, the closer they are to 6%. Ina 
similar way, the expert determines the fuzzy values of cash inflows and outflows in 
subsequent years for project P; and project P2, respectively, in Tables 8.1 and 8.4. 
In order to simplify the analysis, the data are expressed in thousands of arbitrary 
monetary units (a.m.u.). 

To a triangular fuzzy number A = [a, b, c] has a corresponding OFN: 


Aorn = ((b — a)x +a, (b — c)x + c), (8.14) 


which is the ordered pair of linear functions (Fig. 8.1). 

By applying the formula 8.14 we define OFNs corresponding to the values deter- 
mined by the expert. For instance, the capitalization rate expressed by OFNs assumes 
the form: Rory = (0.02x + 0.04; —0.01x + 0.07). Then we discount cash inflows 
and outflows using the formula 8.10. Obviously, discounted cash flows in the ith 
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Table 8.1 Input data for the investment P; using triangular fuzzy numbers 
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Year Cash outflows Cash inflows 

0 [450, 450, 450] [0, 0, 0] 

1 [19, 20, 22] [68, 70, 72] 

2 [5, 5, 6] [70, 75, 80] 

3 [4.5, 5, 6] [70, 75, 85] 

4 [4, 5, 6] [90, 100, 125] 
5 [4, 5, 6] [110, 120, 135] 
6 [4, 5, 6] [110, 125, 140] 
7 [4, 5, 6] [100, 110, 130] 


Table 8.2 Cash inflows and discounted cash inflows for Pı with the use of OFNs 


Year Cash inflows Discounted cash inflows 

0 (0, 0) (0, 0) 

1 (2x + 68, -2x + 72) (m: 0o) 

2 (Sx +70, -5x + 80) Creare Sa 
3 (Sx + 70, —10x + 85) Ou , coo) 
4 (10x +90, —25x + 125) (aa ae aun) 
5 (10x + 110, —15x + 135) aa >| oe 
6 (15x + 110, —15x + 140) Ga nae ( Tan) 
7 (10x + 100, —20x + 130) (T02L Conton) 


Table 8.3 Selected rates of return for the project Pı 


Rates of return 
Rı (OFN PV; positive) 


Ro (OF N P Vz negative) 


Triangular fuzzy numbers 
[0.04; 0.07; 0.1] 
[0.06; 0.9; 0.12] 


Ordered Fuzzy Numbers 


(0.03x + 0.04, —0.03x 
(0.03x + 0.06, —0.03x 


0.12) 


0.1) 


year of investment are obtained by adding discounted cash inflows and outflows in 
the ith year of an investment. 

Subsequently, based on the formulas presented in the previous point we calculate 
the indexes OFNPV, OFPI, and OFIRR. Finally, these values undergo defuzzification 
using the functional 8.6. Thus we obtain crisp values, which can be presented to the 
investor. Calculations for the considered investment projects were performed using 
the MATLAB computer program. 

Let us consider the alternative investment project Pı. Table 8.1 presents the cash 
inflows and outflows of the project using triangular fuzzy numbers defined by the 
expert engaged in the decision process. 
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Table 8.4 Input data for the investment project 2 using triangular fuzzy numbers 


Year Cash outflows Cash inflows 

0 [450, 450, 450] [0, 0, 0] 

1 [0, 0, 0] [145, 150, 155] 
2 [0, 0, 0] [140, 150, 155] 
3 [0, 0, 0] [110, 125, 140] 
4 [0, 0, 0] [60, 75, 80] 

5 [0, 0, 0] [60, 75, 90] 
Fig. 8.1 The pair of linear Ay 


functions corresponding to 
the triangular fuzzy number 
A = [a, b, c]. The arrow 
denotes the order of 
functions, the so-called OFN 
orientation 


Table 8.2 presents the cash inflows for the first project expressed in OFNs. The 
cash outflows for this project and the cash inflows and outflows for the second project 
were calculated in an analogous way. 

First we calculated the value of OF NPV and OF PI of the project. After de- 
fuzzification, the net present value for project P; is equal to 47536 a.m.u., which 
means that the projected earnings generated by the proposed investment exceed the 
anticipated costs. The profitability index is equal to 1.0962, which further confirms 
the positive evaluation of the project. 

In order to calculate OFIRR for the first project we selected by successive ap- 
proximations of two rates of return R; and R3 for which ordered fuzzy net present 
values are close to ordered fuzzy zero and positive (R,) or negative (R2), respectively 
(Table 8.3). The internal rate of return for this project is equal to 8.21%. 

Let us consider the alternative investment project P). Table 8.4 presents the cash 
inflows and outflows of the project using triangular fuzzy numbers. 

The NPV for the project P> is equal to 44397 a.m.u. so the project would be 
estimated to be a valuable venture. The PI is equal to 1.0987, which further validates 
the positive evaluation of the project. The internal rate of return for the second project 
calculated on the data presented in Table 8.5 is equal to 9.78%. 

In Table 8.6 we present the results of calculation of the modified discount methods 
for considered projects P; and P2. We compared the obtained values of the proposed 
new methods to aid the decision maker in choosing the best investment project. First 
we determined the NPV for each project; then we established the profitability index 
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Table 8.5 Selected rates of return for the project P2 


Rates of return Triangular fuzzy numbers Ordered Fuzzy Numbers 

Rı(O FN PV; positive) [0.03; 0.08; 0.13] (0.05x + 0.03, —0.05x 
0.13) 

Ro(OF N P V2 negative) [0.06; 0.11; 0.16] (0.05x + 0.06, —0.05x 
0.16) 


Table 8.6 Summarized results of proposed discount methods for the projects 


Methods Project Pı Project P2 
NPV 47536 44397 
PI 1.0962 1.0987 
IRR 8.21% 9.78% 


for each investment project, and finally the internal rates of return. According to 
the NPV analysis alone, project P; is the most appropriate choice for the decision 
maker. The profitability indexes for project Pı and project P vary slightly and they 
are greater than 1, which confirms the profitability of both projects. According to the 
IRR analysis alone, project P is the most appropriate choice for the decision maker. 
The NPV and IRR analysis for these two projects give us conflicting results. This 
is due to the timing of the cash flows for each project as well as the size difference 
between the two projects. By the NPV rule the decision maker should choose project 
P1, so it can be executed. The convention is to use the NPV rule when the two 
methods are inconsistent. It better reflects the primary goal: to improve the financial 
wealth of the company. 


8.6 Summary 


The capital budgeting problem with Ordered Fuzzy Numbers corresponds to the 
project selection problem. We modified the method presented in our previous paper 
by transferring the defuzzification process to another stage of calculations and we 
presented the next discount methods, the profitability index and internal rate of return, 
to make an evaluation of alternative investment projects more precise. Tools of that 
kind can be perceived as a decision-support system based on OFNs. We presented the 
example of alternative investment project selection using new discount methods. The 
presented methods may be used to represent imprecise information, among others 
about cash flows and capitalization rate. They offer a clear simultaneous representa- 
tion of several pieces of information. In addition, well-defined arithmetic operations 
on OFNs make it easy to perform even complex calculations connected, for example, 
with a long period of investment. Moreover, owing to the elimination of issues re- 
lated to using classical fuzzy numbers such as increasing fuzziness over subsequent 
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operations, impossibility to solve equations, or high computational complexity, the 
OFN model may prove to be good tool for economic analysis. It allows modeling the 
uncertainty associated with financial data and constructing a full decision-support 
system in the future. 
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Chapter 9 
Input-Output Model Based on Ordered 
Fuzzy Numbers 


Dariusz Kacprzak 


Abstract The chapter presents the application of Ordered Fuzzy Numbers (OFNs) 
to the economic model. These numbers are used for input-output analysis (the Leon- 
tief model), which is a basic method of quantitative economics that presents macro- 
economic activity as a system of interrelated goods and services. OFNs allow us 
not only to apply mathematical modeling of imprecise or ambiguous data but also 
simultaneously portray more information than could be presented by real numbers. 
It is shown based on the Leontief model, where at the same time the current level, 
the forecast level, and the level of change of the final demand or the production level 
can be determined. The example shows that use of OFNs in economic modeling can 
simplify and deepen the economic analyses. 


9.1 Introduction 


Economics is a social science that studies and analyzes the production, distribution, 
and consumption of goods and services. One of the main tools used in economics is 
model. A model is a theoretical construction representing economic processes by a 
set of variables and a set of logical and quantitative relationships between them. Such 
model often take the form of systems of linear equations, due to their simplicity and 
ease of interpretation of their parameters and solution. One of the most famous and 
popular models of this type is the Leontief model, often called input-output analysis. 

Input-output analysis is a quantitative economic technique that represents interde- 
pendencies between different sectors (industries, branches) and a way of describing 
the allocation of resources of a national economy or different regional economies. 
It is a particularly effective tool for the optimization of production processes, the 
improvement of economic conditions, and cost allocation analysis. The input-output 
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analysis also shows the combination of resources (raw materials, labor, capital), 
called inputs, that are required to achieve desired production goals, called outputs. 
It makes the Leontief model play a central role in planning and forecasting in eco- 
nomics. 

The model proposed by Leontief does not take into account the natural uncer- 
tainty of variables of such complicated mathematical descriptions as the real-world 
economy models. The application of these variables in models involves knowing 
their numerical values. However, in reality many economic variables are difficult 
to be precisely measured. The elements of the Leontief model, such as a technical 
coefficients matrix, an output matrix, or a final demand matrix, are usually known 
as some intervals or fuzzy numbers. The use of only mean values in these matrices 
can lead to the loss of valuable information. In other words, in practical applications 
parameters are described using not only single values but intervals and fuzzy sets 
and numbers, in particular Ordered Fuzzy Numbers (OFNs). Properties of operations 
and the possibility of different interpretations of OFNs make these numbers widely 
used in economics. 

There are papers in the literature in which the OFNs model is used in economic 
models. This model was applied, among others, to support decision making [9, 10, 
14], for presentation of revenues and costs of a company [2, 3, 7], in the Leontief 
model [1, 2], for the presentation of stock prices [4, 8, 13], for the presentation of 
prices and the dynamics of their changes [5], and to determine the economic size of 
the delivery [6, 11]. These applications are based on the orientation of the OFNs as 
additional information and the arithmetics of the OFNs similar to the arithmetics of 
real numbers. 

The chapter is organized as follows. Section9.2 describes the fundamental con- 
cepts of input-output analysis. Next, in Sect. 9.3 a numerical example of input-output 
analysis based on OFNs is presented. Finally, concluding remarks are provided in 
Sect. 9.4. 


9.2 Input-Output Analysis 


The American economist Wassily W. Leontief developed the economic input-output 
model (the term “intersectoral” analysis is also used), which was first published in 
1936. The beginnings of input-output analysis in economics are most often cred- 
ited to Leontief and others who wrote the paper, “Studies in the Structure of the 
American Economy” [12]. In 1973 Leontief was awarded a Nobel prize for his great 
achievements in economics. The prize motivation was: “For the development of the 
input-output method and for its application to important economic problems.” His 
model is a basis for more models currently being used in many parts of the world. 
It can be applied to an economy of any size, from a small business or a region, to 
a whole country or the whole world. The Leontief input-output model leads to a 
better understanding of modeling economic systems, because it describes how the 
input and output of different sectors affect each other. The main goal of the Leontief 
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input-output model is to balance (equilibrium) the total amount of goods produced 
(total output) to the total demand (total input and final demand) for that production, 
in other words, consumption equals production. 

Because the input-output model normally encompasses a large number of sectors, 
its framework is quite complicated. To simplify the analysis (model), the following 
assumptions are adopted: 


e each sector produces only one homogeneous product, 

e each sector uses a fixed input ratio (or factor combination) for the production of 
its output, 

e production in every sector is subject to constant returns to scale, so that a k-fold 
change in every input will result in an exactly k-fold change in output. 


In general, let us suppose an economy has n sectors. The output of any sector, say 
the ith sector, is needed as an input in many other sectors, or even for that sector 
itself. It means that the level of the output of the ith sector will depend on the input 
requirements of all the n sectors. On the other hand, the output of many other sectors 
will enter an input into the ith sector, and consequently the levels of other sectors 
products will depend partly on the input requirements of the ith sector. In view of 
these intersectoral dependences, it is clear that the input-output analysis should be 
of great use in production planning. This leads to the fact that the Leontief model 
allows answering the question: “What output level should reach each of the n sectors 
in an economy in order to satisfy the total demand for that product?” To present the 
input-output model the following designations are introduced (they are expressed in 
financial terms, for example, in millions of dollars): 


e X=(X; X ... X): A production vector, where X; (i = 1, ..., n) denotes the 
total value of the output of the ith sector for a year 

e d=(d; də ... d,)": A final demand vector, where d; (i = 1, ..., n) denotes the 
total value of goods and services demanded from the ith sector by a nonproductive 
part of the economy (an open sector) 

e xij (i, j = 1, ..., n): Flow of production from ith sector to the jth sector; part of 
the output of the ith sector used in the jth sector for the production of its output 


A starting point for an input-output analysis is an input-output table. An input- 
output table is a description of the flows (relationships) of goods and services among 
different sectors of a particular economic system. In the table, each horizontal row 
describes how one sector’s total product is divided among various sectors and final 
consumption. In turn, each vertical column denotes the combination of productive 
resources used within one sector. These flows concern a particular period, usually a 
one-year period. Table 9.1 shows a representation of an input-output table. 

The structure of the table is a matrix that lists economic sectors, in the same 
sequence, both vertically and horizontally. If the rows of Table 9.1 are considered, for 
each ith sector (i = 1, ..., n), a linear equation describing how the sector distributes 
an output to other sectors can be written as 
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Table 9.1 An input-output table 


Sector 1 2 oes n Total output | Final demand 
1 X11 X12 Di Xin Xı dı 
2 x21 x22 ge X2n X2 dy 
n Xn Xn2 see Xnn Xn dn 


Xı = X1 + x12 + -+ Xin + dı 


Xa = X21 + x2 +... + Xn + d (9.1) 


Xn = Xni + Xn2 +... + Xan + dn 


From the assumptions of the model: in order to produce each unit of the product 
of the jth sector, the input needed for the product of the ith sector must be a fixed 
amount, which should be denoted by a;; belonging to [0, 1). Each element a;j is 
named the input coefficient or the technological coefficient and is calculated as 

Xij M 
aj = -> (i, j=1,...n). (9.2) 

J 

The coefficients a;; are fixed by the current technology (when technology changes, 
coefficients change as well). From the formula (9.2) 


xij =ajjXj (i,j =1,...n) (9.3) 


where elements a;;X ; for j = 1, ..., n are the inputs demand of the jth sector. If Eq. 
(9.3) are put into (9.1), a linear system of Eq. (9.1) takes the form 


Xı = ay Xı +4a12X2 4+... Hayy Xn + dı 
X2 = a21 Xı + a2X2 +... + Amn Xn + d2 


(9.4) 
Xn = Ani X1 + Gn2X2 + ... + annXn + dn 
or, following application of a matrix algebra, it can be written as 
Xı 411 412 «.. Ain Xı dı 
X2 | _ | 421 a2 ~ an X2 4 dy (9.5) 
Xn Any an2 +» Ann Xn dn 


or in short 
X=AX+d (9.6) 
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where X denotes the output matrix, A is the matrix of technological coefficients, and 
d is the final demand matrix. 

Very interesting from an economic point of view is matrix A, in which each col- 
umn determines the input requirements for the production of one unit of a particular 
sector. This means that the production of each unit of the product of the jth sector 
requires a ; unit of the product of the first sector, a2; unit of the product of the second 
sector,..., and anj unit of the product of the nth sector. Because of the presence of the 
open sector, the sum of the elements in each column of the input coefficient matrix 
A must be less than 1. If this sum is greater than or equal to 1, production is not 
economically justifiable. 

Equation (9.6) can be written in the form of the Leontief model (J denotes a unit 
matrix of size n) 

X-AX=d <= (U-A)X=d. (9.7) 


The matrix (J — A) is called the Leontief matrix and converts a total production 
vector X into a final product vector d. The question appears immediately: “If the final 
product vector d is given, can the situation be reversed and can the total production 
vector X be determined?” To answer the question the concept of a productive matrix 
should be introduced. A matrix of input coefficients A is productive if there is a 
nonnegative vector of total production X (i.e., all its entries are nonnegative, for 
each i element x; > 0), such that X > AX. The condition X > AX has a simple 
economic interpretation. If A is a productive matrix, the ith element of the vector 
AX is the total production value of all sectors used by the ith sector in a year. Hence, 
the condition X > AX means that, for each i, the value of the product produced by 
the ith sector exceeds the value of the products used by the ith sector. In other words, 
each sector runs at a profit. 


Theorem 1 Let A be a square and a nonnegative matrix. Then (I — A) is invertible 
and (I — A)~' nonnegative, if and only if the matrix A is productive. 


One can notice from the above theorem that in the real economy the final product 
d determines the total production X, according to the rule 


X=(I-Ay!d. (9.8) 


If the symbol A is used, for example, AX, to indicate a change in the value of a 
variable X, the change in the size of one variable due to changes in a second one 
using the Leontief model can be determined. The effect in the value of the final 
product, determined by changes in the total production value can be calculated using 
the equation in the following form 


(I — A)AX = Ad (9.9) 


or the change in total production due to the changes in the final product, using the 
equation in the form 
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AX = (I — A)! Ad. (9.10) 


The Leontief model is used for forecasting. Three types of forecasts can be distin- 
guished: 


e first type forecast: When X or AX are given, using formula (9.7) or (9.9) vector 
d or Ad can be determined. 

e second type forecast: When d or Ad are given, using formula (9.8) or (9.10) vector 
X or AX can be determined. 

e mixed forecast: When complementary elements of X and d or AX and Ad are 
given, using the Leontief model in the form (9.7) or (9.9) the remaining elements 
of X and d or AX and Ad can be determined. 


9.3 Example of Application of OFNs in the Leontief Model 


The nature of the input-output analysis makes it possible to analyze an economy as 
an interconnected system of sectors that directly and indirectly affect one another. 
The Leontief model can be used, among others, to analyze how changes in the pro- 
duction level of different sectors affect changes in the final demand. More precisely, 
this model can be used to determine the final demand when production levels of 
different sectors are known, using the formula (9.7) or to analyze how changes in 
the production level of different sectors affect changes in the final demand, using the 
formula (9.9). 

The use of OFNs allows us simultaneously to take into account the formulas (9.7) 
and (9.9). For this purpose, the triangular OFNs of the form X = (fx(0), fx(1), 
gx(1), gx(0)), where fy(1) = gx(J), is used with the following interpretation. The 
real number fx (0) denotes the current production level, whereas the real number 

gx(0) denotes the forecasted production level. Then the orientation of the OFN 
informs us about the direction of a change, that is, it describes the economic situation 
of the sector. More precisely, if fx (0) < gx (0) then the expected economic situation 
of the sector is good and the production level of the sector increases. Otherwise, that 
is, when fx(0) > gx(O) then the economic situation of the sector deteriorates and 
the production level is reduced. When fy(0) = gx(0) then there are no economic 
reasons to change the production level. 

Let us consider a hypothetical economy consisting of only three sectors. The 
input-output table of this economy is presented in Table 9.2. 

Using formula (9.2), the matrix A of the technological coefficients can be calcu- 


lated and takes the form 
0.1 0.2 0.1 


A= | 0.20.4 0.2 
0.3 0.1 0.4 
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Table 9.2 The input-output table of a hypothetical economy 
sector 1 2 3 Xi di 


The Leontief matrix (Z — A) that allows calculating the final demand of the economy 
takes the form 


0.9 —0.2 —0.1 
I— A= į —0.2 0.6 —0.2 
—0.3 —0.1 0.6 


We consider how changes in the production level of different sectors affect changes 
in the final demand of each sector. For the particular sector, depending on the eco- 
nomic situation, three cases are analyzed: no change, and increase or decrease of the 
production level. Obtained results are presented in Tables 9.3 and 9.4, where X is 
the production vector, d is the final demand vector, AX is the change of production 
level vector (i.e., fx (0) — gx (0) where the sign determines the direction of change 
((+) increase and (—) decrease), and Ad is the change of the final demand vector 
(i.e., fa(0) — ga (0) where the sign determines the direction of change ((+) increase 
and (—) decrease). 

Let us consider line 1 of Table 9.3. It shows the economy is stable and there 
are no causes influencing changes in the production level. The production level of 
each sector in the current X, and forecasted X p periods are the same and equal to 
Xe = Xs = (1400 1600 1800)". It means that there are no causes to change the 
final demand level and in the current de and forecasted dp periods it is equal to 
de = dy = (760 320 500)’. 

Line 2 of Table 9.3 shows the situation in which the first sector has a good eco- 
nomic situation and intends to increase the production level from 1400 to 1500, 
whereas the other sectors have a stable situation and their production levels do not 
change. The use of OFNs in the Leontief model allows us to compute, for the cur- 
rent production level equal to X. = (1400 1600 1800)’, the final demand equal to 
de = (760 320 500)’. These numbers also allow us to compute the final demand 
equal to dy = (850 300 470)” after increasing the production level of the first 
sector equal to X = (1500 1600 1800)". This means the increase of the produc- 
tion level of the first sector of 100 units and the unchanged production level of 
other sectors (described by the vector AX = (100 0 0)") cause changes in the 
final demand from d, = (760 320 500)? to ds = (850 300 470)" (described by 
the vector Ad = (90 —20 — 30)"). Changes in the final demands of the sectors 
result from the following facts. 


e Increasing the production level of the first sector and the unchanged production 
level of other sectors causes the increase of the final demand of the first sector. 
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Table 9.3 Production vector X described by OFNs and the calculated final demand vector d and 
the change vectors AX and Ad 


No. | X d AX Ad 
(1400, 1400, 1400, 1400) (760, 760, 760, 760) 0 0 

1. (ce 1600, 1600, 1600) (= 320, 320, mo] f f 
(1800, 1800, 1800, 1800) (500, 500, 500, 500) 0 0 
(1400, 1450, 1450, 1500) (760, 805, 805, 850) 100 90 

2. (ce 1600, 1600, iam (e 310, 310, wo) | 0 (2) 
(1800, 1800, 1800, 1800) (500, 485, 485, 470) 0 —30 
(1400, 1350, 1350, 1300) (760, 715, 715, 670) —100 —90 

3: (ce 1600, 1600, iam (‘se 330, 330, so) | 0 | 20 ) 
(1800, 1800, 1800, 1800) (500, 515, 515, 530) 0 30 
(1400, 1400, 1400, 1400) (760, 750, 750, 740) 0 —20 

4. fa 1650, 1650, m (e 350, 350, so] ( 100 | 60 ) 
(1800, 1800, 1800, 1800) (500, 495, 495, 490) 0 —10 
(1400, 1400, 1400, 1400) (760, 770, 770, 780) 0 20 

5. | (1600, 1550, 1550, am ( (320, 290, 290, o| ( —100 | “| 
(1800, 1800, 1800, 1800) (500, 505, 505, 510) 0 10 
(1400, 1400, 1400, 1400) (760, 755, 755, 750) 0 —10 

6. fa 1600, 1600, | [ss 310, 310, wo] ( 0 (=) 
(1800, 1850, 1850, 1900) (500, 530, 530, 560) 100 60 
(1400, 1400, 1400, 1400) (760, 765, 765, 770) 0 10 

ihe fa 1600, 1600, wn [ss 330, 330, so) ( 0 | 20 ) 
(1800, 1750, 1750, 1700) (500, 470, 470, 440) —100 —60 
(1400, 1450, 1450, 1500) (760, 795, 795, 830) 100 70 

8. (ce 1650, 1650, m (e 340, 340, wo) ( 100 | 40 ) 
(1800, 1800, 1800, 1800) (500, 480, 480, 460) 0 —40 
(1400, 1450, 1450, 1500) (760, 815, 815, 870) 100 110 

9. ( (1600, 1550, 1550, | (320, 280, 280, o| ( —100 I “| 
(1800, 1800, 1800, 1800) (500, 490, 490, 480) 0 —20 
(1400, 1350, 1350, 1300) (760, 705, 705, 650) —100 —110 

10. fa 1650, 1650, m (e 360, 360, «| I 100 ( 80 
(1800, 1800, 1800, 1800) (500, 510, 510, 520) 0 20 
(1400, 1350, 1350, 1300) (760, 725, 725, 690) —100 —70 

11. (‘se 1550, 1550, (e 300, 300, no] (= (-« 
(1800, 1800, 1800, 1800) (500, 520, 520, 540) 0 40 
(1400, 1450, 1450, 1500) (760, 800, 800, 840) 100 80 

12. fa 1600, 1600, wn) (ss 300, 300, 3 ( 0 (2) 
(1800, 1850, 1850, 1900) (500, 515, 515, 530) 100 30 
(1400, 1450, 1450, 1500) (760, 810, 810, 860) 100 100 

13. (ce 1600, 1600, a (e 320, 320, mo) | 0 0 ) 
(1800, 1750, 1750, 1700) (500, 455, 455, 410) —100 —90 
(1400, 1350, 1350, 1300) (760, 720, 720, 680) —100 —80 

14. (ce 1600, 1600, a (e 340, 340, so) | 0 | 40 ) 
(1800, 1750, 1750, 1700) (500, 485, 485, 470) —100 —30 
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Table 9.4 Production vector X described by OFNs and the calculated final demand vector d and 
the change vectors AX and Ad 


No. | X AX Ad 
(1400, 1350, 1350, 1300) (760, 710, 710, 660) —100 
1. (1600, 1600, 1600, 1600) (320, 320, 320, 320) | | 0 
(1800, 1850, 1850, 1900) (500, 545, 545, 590) 90 
(1400, 1400, 1400, 1400) (760, 745, 745, 730) —30 
2. (1600, 1650, 1650, 1700) (320, 340, 340, 360) | | 40 
(1800, 1850, 1850, 1900) (500, 525, 525, 550) 50 
(1400, 1400, 1400, 1400) (760, 755, 755, 750) —10 
3. (1600, 1650, 1650, 1700) (320, 360, 360, 400) | | 80 
(1800, 1750, 1750, 1700) (500, 465, 465, 430) —70 
(1400, 1400, 1400, 1400) (760, 765, 765, 770) 10 
4. (1600, 1550, 1550, 1500) (320, 280, 280, 240) | (=) 
(1800, 1850, 1850, 1900) (500, 535, 535, 570) 70 
(1400, 1400, 1400, 1400) (760, 775, 775, 790) 30 
5. (1600, 1550, 1550, 1500) (320, 300, 300, 280) (2) 
(1800, 1750, 1750, 1700) (500, 475, 475, 450) —50 
(1400, 1450, 1450, 1500) (760, 790, 790, 820) 60 
6. (1600, 1650, 1650, 1700) (320, 330, 330, 340) | (= 
(1800, 1850, 1850, 1900) (500, 510, 510, 520) 20 
(1400, 1450, 1450, 1500) (760, 800, 800, 840) 80 
7. (1600, 1650, 1650, 1700) (320, 350, 350, 380) | | 60 
(1800, 1750, 1750, 1700) (500, 450, 450, 400) —100 
(1400, 1450, 1450, 1500) (760, 810, 810, 860) 100 
8. (1600, 1550, 1550, 1500) (320, 270, 270, 220) | (2 
(1800, 1850, 1850, 1900) (500, 520, 520, 540) 40 
(1400, 1450, 1450, 1500) (760, 820, 820, 880) 120 
9. (1600, 1550, 1550, 1500) (320, 290, 290, 260) | È 
(1800, 1750, 1750, 1700) (500, 460, 460, 420) —80 
(1400, 1350, 1350, 1300) (760, 700, 700, 640) —120 
10. (1600, 1650, 1650, 1700) (320, 350, 350, 380) | | 60 
(1800, 1850, 1850, 1900) (500, 540, 540, 580) 80 
(1400, 1350, 1350, 1300) (760, 710, 710, 660) —100 
11. (1600, 1650, 1650, 1700) (320, 370, 370, 420) | | 100 
(1800, 1750, 1750, 1700) (500, 480, 480, 460) —40 
(1400, 1350, 1350, 1300) (760, 720, 720, 680) —80 
12: (1600, 1550, 1550, 1500) (320, 290, 290, 260) | (a 
(1800, 1850, 1850, 1900) (500, 550, 550, 600) 100 
(1400, 1350, 1350, 1300) (760, 730, 730, 700) —60 
13. (1600, 1550, 1550, 1500) (320, 310, 310, 300) È 
(1800, 1750, 1750, 1700) (500, 490, 490, 480) —20 
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e On the other hand, other sectors, in response to the increasing demand of the first 
sector, transfer to the first sector a greater amount of their production, which causes 
a decrease in their final demand. 


Line 3 of Table 9.3 shows the situation in which the first sector has a bad economic 
situation and intends to decrease the production level from 1400 to 1300, whereas 
other sectors have a stable situation and their production levels do not change. In this 
situation, the results are symmetrical (opposite) to those shown in line 2 of Table 9.3. 

Lines 4-7 of Table 9.3 show the situation in which any sector (second or third one), 
under the influence of the economic situation, changes the production level, whereas 
the production levels of other sectors are not changed. Economic interpretation of 
the situation of the hypothetical economy is analogous to that presented above. 

Now, let us compare the state of the economy presented in lines 2 and 8 of 
Table 9.3. In line 8, in comparison to line 2, the second sector also has a good 
economic situation and intends to increase the production level from 1600 to 1700. 
In this situation, for the current production level equal to Xe = (1400 1600 1800)? 
the final demand, equal to de = (760 320 500)” can be computed. Moreover the 
final demand, equal to dy = (830 360 460)" after increasing the production level 
of the first and second sectors of 100 units is determined. These results mean that 
the increase of the production level of the first and second sectors of 100 units 
and the unchanged production of the third sector (described by the vector AX = 
(100 100 0)7) cause changes in the final demand from de = (760 320 500)" to 
dy = (830 360 460)" (described by the vector Ad = (70 40 — 40)"). Changes 
in the final demands of the sectors result from the following facts (in comparison to 
line 2). 


Increasing the production level in the first and second sectors and the unchanged 
production level of the third sector causes the increase of the final demand in the 
first and second sectors. 

The final demand in the first sector is smaller (in comparison to line 2) because part 
of the production level of the first sector, instead of the final demand, is transferred 
for the increase of the production level of the second sector. 

The final demand of the second sector, which decreased in line 2, increases because 
of the increase of the production level of the second sector. 

The final demand in the third sector is smaller (in comparison to line 2) because a 
greater part of the production level of the third sector, instead of the final demand, 
is transferred to the increasing production level of the first and second sectors. 


Lines 9-14 of Table 9.3 and lines 1-13 of Table 9.4 present situations in which the 
production level of sectors of the economy increases, decreases, or remains unchanged, 
and how it affects the final demand of these sectors. These lines show and allow us to 
observe the current and future final demands of the sectors and how the final demands 
change as a result of changes in the production levels of the sectors. 

A similar analysis can be carried out knowing the final demand vector d (or Ad) 
and calculating the production levels of the sectors X (or AX) of the economy using 
matrix 
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1.36 0.52 0.40 
(I — A)! = | 0.72 2.04 0.80 
0.80 0.60 2.00 


and formulas (9.8) and (9.10). 


9.4 Conclusions 


The chapter presented the concept of an application of Ordered Fuzzy Numbers in an 
economical model, called the Leontief model. These numbers also allow us to present 
more information than real numbers. It is shown, based on the Leontief model, where 
OFNs simultaneously described the current levels, forecast levels, and the levels of 
change, both with regard to the final demand and the production level. It makes the 
OFNs model a very useful tool for mathematical modeling in economics. 
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Chapter 10 
Ordered Fuzzy Candlesticks 


Adam Marszałek and Tadeusz Burczyński 


Abstract The purpose of this chapter is to present how Ordered Fuzzy Numbers 
(OFNs) can be used with financial high-frequency time series. Considering this 
approach the financial data are modeled using OFNs called further ordered fuzzy 
candlesticks. Their use allows modeling uncertainty associated with financial data 
and maintaining more information about price movement at an assumed time inter- 
val than compared to commonly used price charts (e.g., Japanese Candlestick chart). 
Furthermore, in a simple way, it is possible to include the information about volume 
and the bid-ask spread. Thanks to the well-defined arithmetic of OFNs, one can be 
used in technical analysis or to construct models of fuzzy time series in the form 
of classical equations. Examples of an ordered fuzzy moving average indicator and 
ordered fuzzy autoregressive process are presented. 


10.1 Introduction 


High-frequency financial data are observations on financial variables such as quota- 
tions of shares, futures, or currency pairs, quoted daily or at a finer timescale. Data 
containing the most complete knowledge about quotations of the financial instrument 
are prices corresponding to each single transaction made on this instrument. They 
are at the same time the data of the highest possible frequency called ultra-high- 
frequency data or simply tick-by-tick data. 

High-frequency financial data possess unique features absent in data measured 
at lower frequencies, and analysis of these data poses interesting and unique 
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challenges to econometric modeling and statistical analysis [16]. Analysis of tick- 
by-tick data is very difficult, among others, due to the very large number of observa- 
tions, irregular spacing between observations, occurrence price patterns, and long- 
lived dependencies. For various reasons, high-frequency data may contain erroneous 
observations, data gaps, and even disordered sequences. Moreover, Lo and Mackin- 
lay consider that the financial market is a complex, nonstationary, noisy, chaotic, and 
dynamic system but it does not follow a random walk [7]. The main reason is that 
a huge amount of information is reflected in the financial market. The main factors 
include an economic condition, political situation, traders’ expectations, catastro- 
phes, and other unexpected events. Thus one can conclude that stock market data 
should be considered in the framework of uncertainties. 

Making investment decisions based on observation of each single quotation is 
very difficult or even impossible. Therefore a large part of investors very often use 
price chart analysis to make decisions. The price charts (e.g., the Japanese Candlestick 
chart) are used to illustrate movements in the price of a financial instrument over time. 
Note that in using the price chart, a large part of the information about the process is 
lost; for example, using the Japanese Candlestick chart with daily frequency, for one 
day, we know only four prices (i.e., open, low, high, and close), while in this time the 
price has changed hundreds of times. In spite of this, Japanese Candlestick charting 
techniques are very popular among traders and allow for achieving more than average 
profits. More details about the Japanese Candlesticks and trading techniques based 
on them can be found in [12]. 

In our previous papers [8—10] we showed how we can use fuzzy logic, that is, 
Ordered Fuzzy Numbers (OFNs) defined in Chap. 4 (see also [1-3, 5, 13, 14]), to 
model uncertainty associated with financial data and to keep more information about 
price movement. The idea, construction methods, and an example of an application 
of ordered Fuzzy Candlesticks are specifically recalled in this work. In addition some 
new concepts are also presented. 


10.2 Ordered Fuzzy Candlesticks 


Generally, in our approach, a fixed time interval of financial high frequency data is 
identified with Ordered Fuzzy Numbers and it is called ordered Fuzzy Candlestick 
(OFC). The general idea is presented in Fig. 10.1. Note that the orientation of the 
OFN shows whether the ordered Fuzzy Candlestick is long or short. Information 
about movements in the price are contained in the shape of the f and g functions. In 
this sense, functions f and g do not depend directly on the variable tick but depend 
on the relationship between the parameters A and B. In the following sections the 
details of constructing the ordered Fuzzy Candlestick are presented. 

Previous works listed two cases of construction of ordered Fuzzy Candlesticks. 
The first assumes that the functions f and g are functions of predetermined type; 
moreover, the shapes of these functions should depend on two parameters (e.g., 
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TickByTick Chart Ordered Fuzzy Candlestick 


Price 
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Fig. 10.1 Draft of general concept of ordered Fuzzy Candlestick 


linear). Then the ordered Fuzzy Candlestick for a given time series can be defined 
as follows. 


Definition 1 Let {X,: t € T} be a given time series and T = {1,2,...,n}. The 
ordered Fuzzy Candlestick is defined as an OFN C = (f, g) that satisfies the follow- 
ing conditions 1—4 (for a long candlestick) or 1’—4’ (for a short candlestick). 


Xi < Xp. 

f: (0, 1] — R is continuous and increasing on [0, 1]. 

g: [0, 1] > R is continuous and decreasing on [0, 1]. 

Si <S, fd) = $, f0) = min X; — Cı, g(1) = Sz and g(0) is such that the 


= eS 


fag dt 1 
ratos — and — are equal. 
A B q 


t: Xı > Xa: 

2’. f: [0, 1] — R is continuous and decreasing on [0, 1]. 

3’. g: [0, 1] > R is continuous and increasing on [0, 1]. 

4’. Si< S2, fFA)= S2, f0) = max X; + C2, g(1) = Sı and g(0) is such that 


_ Fy F, 
the ratios — and — are equal. 
A B 


In the above conditions the ordered Fuzzy Candlestick center (i.e., added interval) 
is designated by parameters S1, S2 € [min;er X;, Max;e7 X;] and can be computed 
as different kinds of averages (e.g., arithmetic, weighted, or exponential). Cı and 
C2 are arbitrary nonnegative real numbers that further extend the support of fuzzy 
numbers and can be computed, for example, as the standard deviation or volatility of 
X,. The parameters A and B are positive real numbers that determine the relationship 
between the functions f and g. They can be calculated as the mass of the desired area 
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with the assumed density (see Fig. 10.1). Numbers Fy and F, are the fields under 
the graph of functions f~! and g~!, respectively. 


Example 1 Trapezoid OFC 
Suppose that f and g are linear functions in the form: 


f(x) = (by — af) x + af and g(x) = (by — ag) x + ag (10.1) 


then the ordered Fuzzy Candlestick C = (f, g) is called a trapezoid OFC, especially 
if Sı = S2 where it can also be called a triangular OFC. 


Example 2 Gaussian OFC 

The ordered Fuzzy Candlestick C = (f, g) where the membership relation has 
a shape similar to the Gaussian function is called a Gaussian OFC. It means that f 
and g are given by functions: 


f(x) = f(@) =ofv—2In(zZ) + my and g(x) = g(z) = ogy —2ln(z) + me 
(10.2) 


where, for example, z = 0.99x + 0.01. 


The procedure of determining the parameters of the function f and g is shown 
in Algorithm | and the examples of realizations of trapezoid and Gaussian ordered 
Fuzzy Candlesticks are presented in Fig. 10.2. 


Algorithm 1: Calculations of Trapezoid and Gaussian OFC 


1: read time series X, fort = 0, 1,..., T 

2: for X; compute values of min X;, max X;, S1, $2, C1, C2, A, and B 

3: if Xo < Xr then 

4: af = min X, — C1 mf = Sı 

5: by = Sı grp = a 

6: f(x) = (by —apf)x+ap f(z) = of /—2In@) + my 
T: dg = $ ($1 min X; + C1) + S2 Mg = $2 

8: be = S2 Og = —for 

9: g(x) = (bg — dg)x + ag g(Z) = ogy -2 In) + mg 
10: else 

11: af = max X; + C2 mf = S2 

12: bp = of = mA 

13: f&œ)=(bf-af)x+af f(z) = of /—2In@) + my 
14: ag= B(S> max X; — C2) + S| Mg = S| 

15: by = Sy og =—4oy 

16: g(x) = (bg — dg)x + ag g(z)= og/—2 In(z) + Mg 
17: end if-else 
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Fig. 10.2 Examples of trapezoid and Gaussian OFC 


The second case of construction of ordered Fuzzy Candlesticks assumes that the 
functions f and g are defined in a similar way to the empirical distribution in the 
statistical sciences and called an empirical OFC. The calculation procedure of an 
empirical OFC is shown in Algorithm 2, whereas the example of realizations is 
presented in Fig. 10.3. 


Algorithm 2: Calculations of Empirical OFC 


: else 


read time series X; fort = 0, 1,..., T 
for X, compute values of $1, Sz, Cy and C2 
sorting in ascending data X; 
Y, := sort(X;) 
divide data Y, into two subsets 
Y? := {Y;: Yo < Y; < Sı} U {Yo — C1} 
Y,> = {¥j: S2 < Yi < Yr} U {Yr + Co} 
compute empirical cumulative distribution functions 
CDF; and CDF) associated with yf) and y® , respectively 
if Xo < Xr then 
f is approximation of function {CDF, liro-c1.s1 y! 


g is approximation of function {a — CDF») ! 


[S2,Yr+C21 } 


f is approximation of function {CDF |iro-cı „S1] y! 
g is approximation of function {a — CDF») 


Sayr +c} 


: end if-else 
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Fig. 10.3 Example of empirical OFC 


10.3 Volume and Spread 


10.3.1 Volume 


In technical analysis the prices are by far the most important. However, another piece 
of important information about price movement is volume. Volume is the number of 
entities traded during the time period under study. It is used to confirm trends and 
chart patterns. Any price movement up or down with relatively high volume is seen 
as a stronger, more relevant move than a similar move with weak volume [11]. 

In the case of ordered Fuzzy Candlesticks, adding extra information about volume 
is very easy, enough to calculate the parameters A and B using the density associated 
with volume or for empirical OFC, and enough to calculate the empirical distribution 
using prices repeated by volume times. The example of ordered Fuzzy Candlesticks 
without and with volume information are presented in Fig. 10.4. 


10.3.2 Spread 


A spread (bid-ask spread) is simply defined as the price difference between the 
highest price that a buyer is willing to pay (bid price) for an asset and the lowest 
price that a seller is willing to accept to sell it (ask price). It is important to remember 
that spreads are variable, meaning they will not always remain the same and will 
change sporadically. These changes are based on liquidity, which may differ based 
on market conditions and upcoming economic data. In an over-the-counter market, 
dealers act as market makers by quoting prices at which they will buy and sell a 
security or currency. In this case, the spread represents the potential profit that the 
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TickByTick Chart Gaussian OFC without and with volume 
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Fig. 10.5 Example of Gaussian OFC without and with spread information 


market maker can make from this activity, and it’s meant to compensate it for the 
risk of market making. On the other hand, it is a cost for traders. 

In the case of ordered Fuzzy Candlesticks, it is possible to add extra information 
about the bid-ask spread by calculating the parameters S1, Cı and S2, C2, using the 
bid price and ask price, respectively. The examples of ordered Fuzzy Candlesticks 
without and with spread information are presented in Fig. 10.5. 
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fei 


Price 


Fig. 10.6 The daily Japanese Candlestick chart of the dataset with realization of a classical and 
ordered fuzzy simple moving average 


10.4 Ordered Fuzzy Candlesticks in Technical Analysis 


10.4.1 Ordered Fuzzy Technical Analysis Indicators 


Ordered Fuzzy Candlesticks are Ordered Fuzzy Numbers, hence, thanks to their well- 
defined arithmetic [1, 4, 13] can be used to construct a fuzzy version of technical 
analysis indicators such as the simple moving average. 

The classical simple moving average (SMA) with order s at a time period ¢ is 
given by formula 


1 
SMA: (s) = © (Xi Apa aaa (10.3) 


where X; is the observation (real) at a time period ż (e.g., closing prices). 

Now, the ordered fuzzy simple moving average (OFSMA) with order s at a time 
period ¢ is also given by formula (10.3) but the observations X, are OFC at a time 
period rt. Figure 10.6 shows the results of realization of classical (line with xcross 
symbol) and ordered fuzzy (triangle symbols) simple moving average with order 
equal to 14 for the dataset covering the period of 80 days from 02-03-2016 till 02-06- 
2016 of quotations of EUR/PLN. Figure 10.6 also shows the ordered fuzzy simple 
moving average defuzzification by the center of gravity operator (line with circle 
symbol). In technical analysis the moving average indicator usually is used to define 
the current trend. Notice that the ordered fuzzy moving average determines the current 
trend by orientation of the ordered Fuzzy Candlesticks: if orientation is positive then 
then the trend is long, else the trend is short. The process of fuzzification of the other 
technical indicators can be done by analogy. 
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Fig. 10.7 Empirical ordered Fuzzy Candlesticks as technical indicator 


10.4.2 Ordered Fuzzy Candlestick as Technical Analysis 
Indicator 


The method of construction of ordered Fuzzy Candlesticks can be used directly as a 
technical analysis indicator by doing the calculation of OFC over a moving window 
of observations (ticks). The size of the window can be defined as the number of 
observations (e.g., last 100 ticks) or the time (e.g., last 10 min). Figure 10.7 shows 
the results of realization of empirical ordered Fuzzy Candlesticks as a technical 
indicator with window size equal to 15 min for the dataset covering the period of 1 
hour from 3 PM till 4 PM of 02-06-2016 of quotations of EUR/PLN. 

Indicators are used as a secondary measure to the actual price movements and add 
additional information to the analysis of securities. Indicators are used in two main 
ways: to confirm price movement and the quality of chart patterns, and to form buy 
and sell signals. The most common type of indicators is called oscillators and they 
fall in a bounded range. Oscillator indicators have a range, for example, between zero 
and 100, and signal periods where the security is overbought (near 100) or oversold 
(near zero). In a simple way the indicator based on ordered Fuzzy Candlesticks can 
be presented in the form of an oscillator by applying normalization. An example 
of empirical ordered Fuzzy Candlesticks as an oscillator indicator is presented in 
Fig. 10.8. 


10.5 Ordered Fuzzy Time Series Models 


Thanks to the well-defined arithmetic of OFNs, it is possible to construct models 
of fuzzy time series, such as an autoregressive process (AR), where all input values 
are OFC, and the coefficients and output values are arbitrary OFNs, in the form of 
classical equations, without using rule-based systems. 
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Fig. 10.8 Empirical ordered Fuzzy Candlesticks as oscillator indicator 


The classical autoregressive model (AR(p)) is one where the current value of 
a variable, depends only upon the values that the variable took in previous periods 
plus an error term [15]. In the presented approach, an ordered fuzzy autoregressive 
model of order p, denoted OFAR(p), in a natural way is fully fuzzy AR(p) and can 
be expressed as 


X 


ll 
gl 
+ 
RI 
bs 
| 
+ 
Dl 


(10.4) 


where X,_; are the ordered Fuzzy Candlesticks at a time period t, @ are fuzzy 
coefficients given by arbitrary OFNs, and &; is an error term. 


Estimation of OFAR(p) Model 


The least squares method is proposed for the estimation of fuzzy parameters 
Qi = (fa; + Za; ) in the OFAR(p) model and one is defined using a distance measure. 
The measure of the distance between two OFNs is expressed by the formula: 


d(A, B) =d((fa, ga), (fe, 88) = Il fa — felz + llega — gale (10.5) 


where || - || is a metric induced by the L?-norm. Hence, the least squares method for 
OFAR(p) is to minimize the following objective function, 


P 
E= a ea a + Yak.) (10.6) 
t i=1 


Forecasting Using the OFAR(p) Model 


Forecasts of the OFAR(p) model are obtained recursively in a similar way as for 
the classical AR(p) model. Let ¢ be the starting point for forecasting. Then, the 
one-step-ahead forecast for X;+1 is 
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Xi =A + > QX. (10.7) 


The result of the forecast is an Ordered Fuzzy Number, which includes three kinds 
of predictions: 


e Point forecast: Given by the value of a defuzzification operator (for defuzzification 
operators see [2, 6]) 

e Interval forecast: Given by the subset of support of the OFN in its classical 
meaning 

e Direction forecast: Given by orientation of the OFN. 


10.6 Conclusion and Future Works 


In this chapter, the representation of financial data using the concept of the ordered 
Fuzzy Candlestick is described. The ordered Fuzzy Candlestick holds more infor- 
mation about the prices than the classical Japanese Candlestick. Moreover, it is also 
possible to include information about the volume and spread. Based on well-defined 
arithmetic of Ordered Fuzzy Numbers, the proposed approach enables us to build the 
technical analysis indicators and the fuzzy financial time series models in the simple 
form of classical equations. It allows reducing the size of models compared to models 
based on fuzzy-rule-based systems. For future work, our approach can be extended 
by adding the concept of fuzzy random variables, which can allow for the simulation 
of models and their application in many other areas of financial engineering. 
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Chapter 11 
Detecting Nasdaq Composite Index Trends 
with OFNs 


Hubert Zarzycki, Jacek M. Czerniak and Wojciech T. Dobrosielski 


Abstract The chapter presents a novel way of describing changes in the stock index 
and the identification of potential trends. The authors already used a similar approach 
to describe the stock exchange index [16]; this chapter is a continuation and another 
application of work on this issue. The method for detecting patterns in a trend by 
means of linguistic variables is described. The use of computational operations on 
numbers in the Ordered Fuzzy Number (OFN) notation [40-42] enables us to set 
the values of linguistic variables and thus conduct fuzzification of the input. By 
using one OFN number it is possible to store five parameters of index quotations 
(open, high, low, and close values as well as a change direction). The OFN numbers 
are conveyed into a linguistic form. In order to find trend sequence similarity the 
following applies: sequence identity with the input frame expressed as a percentage, 
frame size, the level of threshold conformity with the frame (threshold), and how 
often the pattern is present (frequency). A dedicated computer program to detect 
patterns is implemented. The program used data from the index Nasdaq Composite 
from the years 2006-2016. The results represent a further step to develop effective 
methods of rule-based forecasting. 
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11.1 Introduction 


In comparison to existing methods, more accurate forecasting methods can be 
obtained using a rule-based forecasting (RBF), a technique combining data extrapo- 
lation [7, 13, 14, 25, 26, 43-45], time series [28, 29, 44, 45], and elements of expert 
systems [5—7, 22, 23, 34, 37, 46]. The four most important methods of extrapolation 
were used: linear regression, random walk, and Brown’s exponential smoothing, as 
well as Holt’s exponential smoothing. In order to create rules some information from 
the literature, surveys, and knowledge of several experts was adapted [17, 19-21, 
36, 38, 39]. The rules were calibrated using 80 time series. In contrast, the validation 
needed another 40 series. In the opinion of the authors, RBF has been successfully 
applied by combining domain expertise with statistical methods. This has been con- 
firmed by many studies in the recent literature, where rule-based forecasting is a 
fast-growing technology. It is worth mentioning a few examples from a very com- 
prehensive literature such as M. Adya, J.S. Armstrong, and F. Collopy [1-3, 8, 9], 
who publish in the International Journal of Forecasting, a magazine that inspires 
other authors associated with the RBF methods. In this chapter time series of index 
data were preliminarily fuzzified [30, 33] to check the proposed methods of detect- 
ing trends [18]. Trends identified in the sequence of literals are then used to develop 
trend prediction rules. Therefore fuzzy logic [12, 13, 16, 35] was used to develop 
linguistic data input. Data for the study were quotations of the Nasdaq Composite 
index from the years 2006-2016. Figure 11.1 shows the data in an illustrative man- 
ner. Table 11.1 contains Nasdaq index data for a single trading day. Daily data are: 
opening, maximum, minimum, and closing values as well as the percentage change 
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Fig. 11.1 NASDAQ Composite index quotations from 2006 to 2016 
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Table 11.1 Selected historical NASDAQ Composite index. The dataset covers the time period 
from November 1, 2016 to November 30, 2016 


Index Date Open High Low Close Change 


= 


Nov 30, 2016 5391.35 5393.15 5323.68 5323.68 | -1.26% 


Nov 29,2016 5370.98 5403.86 | 5360.56 5379.92 0.17% 
Nov 28, 2016 5387.92 5396.27 5364.91 5368.81 -0.35% 
Nov 25,2016 5388.49 5398.92 5379.28 5398.92 0.19% 
Nov 23,2016 5366.55 5380.68 5350.68 5380.68 0.26% 
Nov 22,2016 5384.75 5392.26 | 5365.60 5386.35 0.03% 
Nov 21,2016 5336.78 5369.83 5334.16 5368.86 0.60% 
Nov 18,2016 5340.97 5346.80 | 5315.53 5321.51 | -0.36% 
Nov 17, 2016 5295.07 5334.05 5288.16 5333.97 0.73% 
Nov 16,2016 5253.73 5299.63 | 5251.88 5294.58 0.78% 
Nov 15,2016 5241.35 5287.06 5236.25 5275.62 0.65% 
Nov 14,2016 5246.33 5247.17 5192.05 5218.40 | -0.53% 
Nov 11, 2016 5191.82 5241.08 5179.64 5237.11 0.87% 
Nov 10,2016 5283.48 5302.68 5145.32 5208.80 -1.41% 
Nov 09, 2016 5143.86 5258.99 5143.86 5251.07 2.08% 
Nov 08, 2016 5154.99 5214.17 | 5145.30 5193.49 0.75% 
Nov 07, 2016 5128.99 5169.41 5122.77 5166.17 0.72% 
Nov 04,2016 5034.41 5087.51 5034.41 5046.37 0.24% 
Nov 03,2016 5104.70 5115.06 5053.52 5058.41 -0.91% 
Nov 02, 2016 5147.27 5156.70 | 5097.56 5105.57 -0.81% 
Nov 01, 2016 | 5199.77 | 5201.13 | 5112.32 | 5153.58 | -0.89% 


> wann mm AO N e Ar Ss lO alalle 


as compared to the day before. These five values are replaced by the linguistic values. 
Table 11.1 shows both the linguistic values and index quotations. 


11.2 Application of OFN Notation for the Fuzzy 
Observation of NASDAQ Composite 


Data from November this year for the NASDAQ Composite are presented in 
Table 11.1. Quotations are given in a widely used format for this type of time series. 
Subsequent letters of the alphabet represent values for consecutive trading days. 
Figure 11.2 shows an OHLC (open, high, low, close) chart of the Nasdaq Composite 
index for one month. The graph shows the following attributes for each of the daily 
quotations: opening, closing, highest, and lowest value. These attributes, along with 
the change parameter are shown in Table 11.1. In addition, decrease in quotation is 
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Fig. 11.2 Nasdaq Composite OHLC chart for the period of November 1, 2016 to November 30, 
2016 (based on www.stockcharts.com). 


Table 11.2 Characteristic points 


Ordered OFN number fo fi gı go OFN number 
orientation 


Nasdaq Composite Index | Open High Low Close Change 


marked in red and increase is marked in black. Positions A, B, and C in Fig. 11.2 
show a decrease in quotations on specified days. Another four quotations-D, E, F, 
G-show an increase in the value of the Nasdaq Composite. A very large spread 
between the minimum and maximum value, and between the opening and closing 
are on H; these are decreasing quotations. This is followed by increases to date S 
with only two days of drops (J and N) in the range. Point P is interesting, because the 
opening value is virtually level with the closing value, despite some fluctuations of 
the Nasdaq Composite value during the trading day. It is essential that P be located 
near the top of the local peak. Then visualizations T and W demonstrate declines 
from the local peak. As the chart above may not be unambiguous in terms of the 
trend interpretation the authors introduce the logic of Ordered Fuzzy Numbers [14, 
24, 30] in order to interpret the quotations. Table 11.2 shows the OFN characteristic 
points with the Nasdaq Composite quotation parameters as listed in Table 11.2. 
Figure 11.4 is an OHLC chart with Nasdaq index parameters. In the considered 
single day there has been an increase in quotations. The translation of data from 
Fig. 11.4 on the OFN is presented in Table 11.3. The resulting fuzzy number is inter- 
preted graphically in Fig. 11.3. The arrow of fuzzy numbers is directed towards 
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Table 11.3 Example of positively directed OFN number for the Nasdaq index 


OFN number fo Fay ga) &(0) OFN number 
positive 
orientation 

Nasdaq Composite Index | Open High Low Close Change (positive 
value) 

M(x) 
14 
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Fig. 11.3 Graphically displayed positively directed OFN number and its characteristic points as 
used for the Nasdaq Composite 
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Fig. 11.4 Graphically displayed change parameter positive value as used in the Nasdaq Composite 
OHLC chart 


increasing values symbolizing the positive direction of the OFN and reflecting an 
increase in the quotations. 

Figure 11.5 shows the fuzzy number stretched on the same values as in Fig. 11.3. 
However, the direction of the OFN here is the opposite. Chart 2.6 depicts the decrease 
in quotations for a single day of trading. It should be noted that the equivalent of the 
index’s downward movement is a negative direction of the OFN (Fig. 11.6). 
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Fig. 11.5 Graphically displayed negatively directed OFN and its characteristic points as used for 
the Nasdaq Composite 
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Fig. 11.6 Graphically displayed change parameter negative value as used in the Nasdaq Composite 
OHLC chart 


11.3 Ordered Fuzzy Number Formulas 


Nasdaq Composite index values R; + Rn relate to a single trading day. Fuzzy obser- 
vation in OFN notation is performed on a set of R. The observation is for one depen- 
dent and four independent attributes. For each day the number R; € {Ri + Rm} is 
created of the four required values. Symbols of time are, respectively, t;, the day of 
the measurement, whereas to pen, turn, timax itcLoseE are, respectively, quotations 
of opening, minimum, maximum, and close value (Table 11.4). 


Definition 1 On a given day t;, the set forming fuzzy observation of the Nasdaq 
Composite index, is provided as 


R/t; € {R©/topen, R” /turn, R” /tmax, R/tcrose} (11.1) 


where 
tcLosE > {turin,tmax} > toPpeNn 


fr(O) < fRA) < grQ) < gr) 
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Table 11.4 Example of a negatively ordered OFN as an interpretation of the Nasdaq index 


OFN fo fa) ga) 8(0) OEN positive 
orientation 

Nasdaq Composite Index | Open High Low Close Change (negative 
value) 


The OFN arrangement (order) is synonymous with the measurement time of t 
movement intensity, where t € {topen, turn, imax, tcLose}. The measurements 
must be performed in a specific order. The OFN order in Fig. 11.3 is the direction 
of index changes for one trading day. The default direction of OFN R is positive 
(Fig. 11.2). 


Lemma 1 
Reiose < Ropen 
Rpositive = | Ropen, Ruin, Rmax, Revose (11.2) 
fr), fra), grQ), gr(0) 


and the opposite case is 


Retose > Ropen 
Rnegative = Rczose; Rmax, Ruin, Ropen (11.3) 


fr), fr), 8R), gr) 


The NASDAQ was launched in the 1970s and was the first fully electronic secu- 
rities trading system in the world. The stock market traded shares of companies 
mainly related to modern technology (IT). The Nasdaq Composite is one of the three 
major US indices, next to the Dow Jones Average and the S&P500 [47-50]. As for 
2016, listed on the NASDAQ are approximately 3,000 companies, including Apple, 
Google, Microsoft, and Intel. The Nasdaq composite index is an aggregate of the 
common stocks listed on the NASDAQ stock market. The formula for aggregating 
fuzzy observation of subaggregate Sm for n component companies of the index is as 
follows. 


Definition 2 Fuzzy observation of index Nasdaq Composite at the time t; is a set of 


. R ositive Rne ative 
D | a) (11.4) 
i=l i i 
where n < 3000 and w; € {w1,...Wņn} is a vector of the individual companies’ 


impact, default w; = 1. 
The weight of each company in the index is 


Rj * w; 


ae eae 
J m 
Doin Ry * wi 


x 100% (11.5) 


where j € [1, m] 
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Definition 3 If asubaggregate Sm of the Nasdaq Composite aggregate with a certain 
number n of (e.g., sector-related) companies has a different direction of the OFN from 
the direction of the main index, then it can be assumed that it is a predictor of trend 
change. This includes the rule: 


IF NasdaqComposite is positive AND Sm is negative 


THEN Possible change is true (11.6) 


11.4 Conclusions 


Investing in the stock market is associated with high risk. This is due to the lack of 
ideal solutions for the analysis of market data and predictions in short- and long-term 
changes in indices, major stock market indicators. Processes occurring on the stock 
markets have nonlinear chaotic characteristics, making it difficult to study them. The 
technical analysis often uses expert knowledge and expert rules to detect and use 
recognizable trends [43]. One can base investment strategy on trends that will bring 
profits during the boom and limit losses when a market is in decline. Expert knowl- 
edge and rules can be transferred to digital form. Currently, there are many methods 
for identifying trends on the stock exchange [16, 50]. Many of them are unattractive 
due to their complicated structure. An interesting alternative to describing the phe- 
nomenon of the trend is the application of fuzzy numbers and fuzzy logic [4, 10, 11, 
31, 32]. The chapter presents Ordered Fuzzy Numbers, which use five specific index 
parameters as well as index analysis methods to identify the occurrence of a trend. 
Ordered Fuzzy Number notation made it possible to replace up to five attributes 
(open, close, high, low, change) describing the index quotes with a single OFN. In 
addition, the use of OFNs lets one quickly detect changes in the trend, which is very 
important in short-term investments. The authors previously proposed similar solu- 
tions based on research WIG20 [16]; there are also other works on similar solutions 
and financial investment [27, 28]. The authors intend to carry out further research in 
this area in order to find more versatile and accurate prediction models to identify 
market trends. 
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Chapter 12 


OFNAnt Method Based on TSP Ant Colony 
Optimization 


Jacek M. Czerniak 


Abstract This chapter presents a hybrid method of swarm intelligence current. 
Intelligence represented by ant colonies has been enriched with fuzzy logic arith- 
metics. In this case Kositiski’s Ordered Fuzzy Numbers were specifically used. Apart 
from a fuzzy decision model of a single ant used earlier by other researchers, the 
author used the order as a trend support. By associating the direction of a number 
in Ordered Fuzzy Numbers (OFNs) with the trend observed in the ant colony it is 
possible to provide a unique description of a fuzzy observation of a colony behavior. 
The experiments were carried out in the area of searching for the optimal connect- 
ing route in the field. The experiment covered 10 complex issues of searching for 
the optimal route. All are benchmarks from the TSPlib repository which are well 
known among researchers. They represent the actual problems of route selection 
such as transport connections depending on geographic conditions and optimizing 
the machining process or the layout of the power networks. The complexity level 
of optimal solutions for problems to be solved amounted from several hundred to 
several thousand connections. Each of them was solved using six swarm intelligence 
methods and five well-known classical methods dedicated to the traveling salesman 
problem (TSP). The results were presented in the form of tables and graphs, and 
some of the routes were shown in graphical form. Final conclusions of the experi- 
ment indicate the superiority of methods based on ant colony optimization as regards 
closeness to optimal solutions. The results achieved by the OFNAnt method are gen- 
erally better (in 92% of cases) than those achieved by classic methods and are in the 
forefront of solutions from the swarm intelligence group. 


12.1 Introduction 


The observation of living organisms is an interesting research field not only for biol- 
ogists. A new current within artificial intelligence called swarm intelligence acquired 
significance in the 1990s [15]. Those studies were inspired by observation of animals 
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and insects living in colonies [44]. We have finally got successful experiments and 
methods based on ant or termite colony observation [13, 20, 43, 45]. Observations 
of birds in V-formation inspired many researchers to create and to develop the con- 
cept of particle swarm optimization. [24]. Those studies in the field of AI were also 
inspired by information obtained from marine biologists on the collective intelli- 
gence of a shoal of fish or plankton. Other sources of inspiration stemmed from the 
development of industry, in particular the automotive industry in that case. Particle 
swarm optimization was created thanks to studies on, among others, sandblasting 
of a car body or other corroded metal parts. Hence, generally, this branch of AI has 
been called swarm intelligence [11, 14, 25, 38]. Conversion of those intelligence 
mechanisms prevailing among simple individuals into the field of computer systems 
resulted in creation of the current sometimes called computational swarm intelli- 
gence. It exists parallel to the branch of science called multiagent systems and those 
two fields often overlap one another. Although they are often not directly based on 
associations with colonies of living organisms, they are often similar in their rules 
of operation. They enable creation of interesting implementations in the domain of 
parallel computing. The development of swarm intelligence was preceded by the 
development of multiple-valued logic, in particular, fuzzy logic. The author of fuzzy 
logic is an American professor at Columbia University in New York City and Berke- 
ley University in California, Lotfi A. Zadeh, who published the paper entitled “Fuzzy 
Sets” in the journal, Information and Control, in 1965 [5]. He defined the term of 
fuzzy set there, thanks to which imprecise data could be described using values from 
the interval (0,1). The number assigned to them represents their degree of member- 
ship in this set. It is worth mentioning that in his theory Zadeh used the article on 
three-valued logic published 45 years before by a Pole, A. Janukasiewicz [6]. That 
is why many scientists in the world regard this Pole as the "father" of fuzzy logic. 
The next decades saw the rapid development of fuzzy logic. As the next milestones 
in the history of that discipline one should necessarily mention L-R representation 
of fuzzy numbers proposed by D. Dubois and H. Prade [7, 8], which enjoys great 
success today. Coming back to the original analogy, an observer can see a trend, 
that is, a general increase during a rising tide or decrease during low tide, regard- 
less of momentary fluctuations of the water surface level. This resembles a number 
of macro- and micro-economic mechanisms where trends and time series can be 
observed. The most obvious example of that seems to be the bull and bear markets 
on stock exchanges, which indicate the general trend, while shares of individual 
companies may temporarily fall or rise. The aim is to capture the environmental 
context of changes in the economy or another limited part of reality. Changes in an 
object described using fuzzy logic [30, 32] seem to be thoroughly studied in many 
papers. But it is not necessarily the case as regards linking those changes with a trend 
[39, 41, 42]. This might be the opportunity to apply generalizations of fuzzy logic 
which are, in the opinion of authors of that concept, W. Kosiński [9-11] and his team 
[12, 13], Ordered Fuzzy Number (OFN) [28, 33, 40]. There are already interesting 
studies available published by well-known scientists [1, 18] that present successful 
implementation of fuzzy logic to swarm intelligence methods, including methods 
inspired by ant and termite colonies. However, according to the best knowledge of 
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the authors of this chapter, nobody thus far has published studies on implementation 
of ordered fuzzy logic into ant colony optimization. This fact was one of the rea- 
sons for execution of the research described in this chapter. The main emphasis here 
is on application of a new hybrid method of ant colony optimization (ACO) with 
implemented decision logic of an ant calculated in the OFN domain in order to solve 
the optimum route selection problem. To make a comparison, the authors selected 
several well-known ant methods and several heuristic methods dedicated to solving 
the same problem, the methodology of which does not use either swarm intelligence 
or, in particular, ACO. 


12.2 Application of Ant Colony Algorithms in Searching 
for the Optimal Route 


Ant colony optimization is currently one of the best known ant colony algorithms. It 
was first defined by Dorigo, Di Caro, and Gambardell in 1999 [16] as a method for 
discrete optimization problems. ACO was presented as the algorithm that can find a 
good route using a graph. It was inspired by foraging theory [14] both for ant colonies 
and for discrete optimization problems. This algorithm is designed for solving two 
kinds of static and dynamic optimization problems. In the general case, ant colony 
optimization is performed according to the diagram shown in Fig. 12.1). Studies of ant 
colony algorithms commenced based on observation of ant colony environments. The 
scientists noticed the interesting fact that ants communicate mainly using chemical 
substances which they produce. As has already been mentioned, the key matter in this 


Determine probabilistically 
as to which city to visit next 


Fig. 12.1 ACO block diagram 
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algorithm is indirect foraging communication represented by pheromone trace. The 
advantage of the evaporation of that pheromone is that it can prevent convergence 
for local optimum solutions. Assuming there is no evaporation issue, each time each 
path selected by the first artificial agents would be treated in the same way and would 
be equally attractive, which would make it inapplicable to optimization problems. 
Thus, when one ant finds a good path from the colony to the food source, this path 
becomes preferable for other ants. The idea behind the ACO [13] algorithm is to 
follow that behavior using artificial agents moving within the frame of a graph in 
order to solve a given problem. The ACO algorithm has been used for solving the 
traveling salesman problem. This algorithm has an advantage over genetic algorithms 
or the simulated annealing algorithm. Its important feature is that for a dynamically 
changing graph, the ACO algorithm can work continuously and it can adapt to the 
changes in real-time. Thanks to such properties, it has been applied to the method of 
solving the problem of network routing and urban transportation systems. 
Route selection: An ant shall travel the distance from point i to point j with the 
probability of: 
Pij = Bead (12.1) 
Yn) 


where 1;; is the quantity of pheromone on the route i,j, 7;; defines attraction of the 
route i,j, œ is the parameter used for effect control t;;, and £ is the parameter used 
for effect control n;j. 

Pheromone update: This issue is represented by the following formula. 


Tij = puij + Atij (12.2) 


where q;; is the quantity of pheromone on the route i,j, At;; represents the quantity 
of remaining pheromone, and P is the pheromone evaporation scale. 

Below, we present a more detailed pseudocode of one of the numerous ant colony 
algorithms, called the ACS (ant colony system), that is, ant colony optimization. 
Tables 12.1 and 12.2 present the most important ant colony optimization algorithms 
dedicated to TSP in the chronological order of their publishing. In the methodological 
sense, all the algorithms listed below and described in the following section are direct 
successors of the ant system. This is due to an obvious reason, the ant system method, 
which has become the foundation for the entire new branch of knowledge, was the 
first worldwide success of then young scientist, Marco Dorigo. Now Professor M. 
Dorigo [14] is a world-class expert in the field of swarm intelligence. The set of 
methods presented below is in chronological order. 
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Algorithm 1 Pseudocode of the ACS Ant Colony Algorithm [10] 
: Initialize 

: Repeat { 

: Place each ant in a randomly chosen city; 

: For each ant 

: Repeat { 

: Choose NextCity (each ant); 

: Update pheromone levels using a local rule; 

: } Until (No more cities to visit); 

: Return to the initial cities; 

10: Compute the length of the tour found by each ant; 
11: End For; 

12: Update pheromone level using a global rule; 

13: } 

14: Print Best Path; 


OANDNPWNK 


Table 12.1 ACO algorithms that have already been applied to the TSP 


ACO method Authors 

Ant System (AS) Dorigo 1992; Dorigo, Manizzo, Colorni 1996; 
Elitist AS (EAS) Dorigo 1992; Dorigo, Manizzo, Colorni 1996; 
Ant-Q (AQ) Gambardella, Dorigo 1995-96; 

Ant Colony System (ACS) Dorigo, Gambardella 1997; 

Max-Min AS (MMAS) Sttzle 1999; Sttzle, Hoos 2000; 

Rank-base AS (ASrank) Bullnheimer, Hartl, Strauss 1997—99; 


12.3 OFNAnt, a New Ant Colony Algorithm 


Implementation of OFN to the ant colony system consists mainly in determination 
of the trend and in establishing relationship to the order of the OFN. This order is 
used in OFNAnt in two ways. It is related to pheromone evaporation on the route 
and its mathematical description, and it also concerns the decision-making process 
of a single ant. 

The pheromone quantity on the route is updated in accordance with OFN arith- 
metic. If the pheromone trace (quantity) on the route increases, then this trend is 
marked as a positive order trend, whereas if this quantity decreases it is marked as 
a negative order trend. Each pass of the kth ant, which is associated with placing 
pheromone trace results in the update of the pheromone trace on the route by the 
amount left by the ant resulting in positive order on the route with increasing trend 
and with negative order for decreasing trend of the route. The above relationship is 
pursuant to the formula: 


m 


tila, 15, 14, pal — tilda, 15, 14, pal + >) Ath Uk, 1g, 17, pel (12.3) 
k=1 
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Table 12.2 List of analyzed problems including their optimum values 
No | Problem Optimum | Description Author 
designation 
Eil51 426 Problem for 51 towns Christofides / Eilon 
2 D198 15780 Represents the Dribling Reinelt 
Problem. Size of the problem: 
198 holes 
3 Gil262 2378 Problem for 262 towns Gillet/Johnson 
Lin318 42029 Problem for 318 towns Lin/Kernighan 
5 Pcb442 50778 Represents the Dribling Groetschel/Juenger/Reinelt 
Problem. Size of the problem: 
442 holes 
6 | Rat783 8806 Problem of 783 points Pulleyblank 
connected to the power 
network 
7 Pcb1173 56892 Represents the Dribling Juenger/Reinelt 
Problem. Size of the problem: 
1173 holes 
8 D1291 50801 Represents the Dribling Reinelt 
Problem. Size of the problem: 
1291 holes 
9 | Nrw1379 56638 The problem for 1379 Bachem/Wottawa 
towns/villages in North 
Rhine-Westphalia 
10 | Pr2392 378032 Problem for 2392 towns Padberg/Rinaldi 


Every ant constructs a complete route, and the ants make a decision at each stage of the 
route construction. This creates a multistage process of fuzzy control. When talking 
about route construction, we usually refer to the situation when an ant located in town 
i wants to go to town j and makes a decision based on the following information. 


1. Parameters defining the effect of the pheromone trace Ti- 


2. (b) Parameters defining the effect of heuristic information n: used to estimate 
attraction of the route. 

3. NE Parameter representing the list of k available neighbors of an ant. The "avail- 
able" neighbors mean the towns that have not been visited yet. 


The decision-making process taken by an ant at each node of the route is asso- 
ciated with calculation of fuzzy probability in the OFN sense. The probability is 
calculated pursuant to the following redefined formula of the route selection proba- 


bility (Fig. 12.2). 


Pills Ue pal = 


Itla, 14, 14, pall*lnijlla, 14, 14, pall? 


(12.4) 
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Fig. 12.2 An ant located in > 


the town i selects next town j 


12.4 Experiment 


12.4.1 Experiment Execution Method 


In this section, the author compares the effectiveness of heuristic methods, meta- 
heuristic methods, and the new hybrid method OFNAnt. All those methods are tested 
using 10 benchmarks for their performance in solving an NP-hard problem such as 
TSP. Thus, it is a comparison of well-known algorithms with a completely new 
approach represented by OFN arithmetics implemented to control an ant colony in 
order to solve optimizing problems [21, 22, 27]. They are tested according to the 
following principles. 


1. 


As regards ant colony algorithms, a program with implemented method is run 
three times at t= 10 for each problem, and for implementation of heuristic algo- 
rithms a program is also run three times, but without additional parameters. 


. Effectiveness of a given algorithm is assessed as follows: 


e By specification of the obtained result (route length) 
e As a percentage, that is, optimum achieved in x%, as presented in the table 
including the set of benchmarks 


. A graph showing the effectiveness of individual algorithms is presented for each 


of the 10 problems. 


. Each such graph is provided with a short summary where the obtained results are 


discussed. 


. An overall graph showing the effectiveness of all algorithms is presented at the 


end. The value optimum achieved in x% is totaled for each algorithm, and thus 
the overall score per 1,000 available points is calculated. Such a data presentation 
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allows easy assessment of the hierarchy of all the algorithms on the basis of the 
10 benchmarks used for tests. 


12.4.2 Software Used for Experiment 


The author’s own implementation of ant colony methods developed in JAVA lan- 
guage was used in the experiments and the results obtained by the implementation 
were verified on the basis of ACOTSP [14]. The author’s OFNAnt method was added 
to the implementation. The CONCORDE application was developed to solve sym- 
metric TSP-type problems and other problems of network optimization [3, 17]. The 
application is supported by the Office of Naval Research, National Science Founda- 
tion, and by the School of Industrial and System Engineering at the Georgia Institute 
of Technology, United States. This program uses the cutting planes algorithm. The 
interface of the program shows the optimum solution searching process displayed 
at the end of each main iteration. The edges are colored according to currently cal- 
culated LP value (linear programing relaxation). At the moment when a new, better 
solution is found, the color of edges is changed to red. The program includes several 
algorithms designed to create edges used by the program to search for the optimum 
solution. Those algorithms include: 


1. Delaunay triangulation 
2. Minimum spanning tree 
3. Different variations of nearest neighbors 


The program also includes several heuristic [2] algorithms for the TSP problem. 
Those algorithms include: 


. Greedy algorithm (GR) 

. Boruvka algorithm (BOR) 

. Quck Boruvka algorithm (QBOR) 
. Nearest neighbor algorithm (NN) 
. Lin-Keringhana algorithm (LK) 


AWN FR 


12.4.3 Experimental Data 


Table 12.3 shows 10 benchmarks selected from the TSPlib library of TSP problems, 
including the expected optimum value for each. They were applied in a way described 
in the previous paragraph as a set of benchmarks for testing well-known algorithms 
and a new OFNAnt method. 
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Table 12.3 List of analyzed problems including their optimum values 


Data sets ACOTSP Concorde TSP 

* tsp file | optimum | AS ASRK | OFNAnt | ACS GR QBOR |LK 
eil51 426 426 426 426 426 521 480 426 

% 100,00 | 100,00 | 100,00 | 100,00 | 81,77 88,75 100,00 
d198 15780 15781 15780 15780 15780 18399 18140 15828 
% 99,99 100,00 | 100,00 | 100,00 | 85,77 86,99 99,70 
gil262 2378 2380 2378 2378 2378 2846 2818 2380 
% 99,92 100,00 | 100,00 | 100,00 | 83,56 84,39 99,92 
1in318 42029 42091 42029 42029 42029 49744 54090 42272 
% 99,85 100,00 | 100,00 | 100,00 | 84,49 77,70 99,43 
peb442 | 50778 50964 50883 50778 50778 61891 58695 51071 
% 99,64 99,79 100,00 | 100,00 | 82,04 86,51 99,43 
rat783 | 8806 8833 8812 8808 8806 10294 10402 8831 
% 99,69 99,93 99,98 100,00 | 85,54 84,66 99,72 
peb1173 | 56892 57612 56950 57040 56897 65829 66493 57063 
% 98,75 99,90 99,74 99,99 86,42 85,56 99,70 
d1291 50801 51020 50824 50870 50820 59293 57228 52729 
% 99,57 99,95 99,86 99,96 85,68 88,77 96,34 
nrw1379| 56638 57281 56859 56917 56770 66371 66110 56756 
% 98,88 99,61 99,51 99,77 85,34 85,67 99,79 
pr2392 | 378032 | 386541 | 382089 | 381077 | 379602 | 444853 | 448641 | 383277 
% 97,80 98,94 99,20 99,59 84,98 84,26 98,63 


12.5 Results of Experiment 


A number of tests were performed according to the above-specified rules, using 10 
selected problems. Results of individual tests are presented below assisted by the 
diagram and a brief note for each. 

Eil51 The authors presented an experiment for 51 towns, the optimum value 
for which amounts to 426. As a result of the calculations 7 out of 10 algorithms 
generated an optimum result. It is worth noting that only one classical algorithm 
(ALK) generated the best result. Other ALK algorithms showed low effectiveness for 
a relatively small problem. All ant colony algorithms showed excellent performance 
when solving the above problem (Fig. 12.3). 

D198 Another test was performed for 198 towns and it showed the advantage of ant 
colony algorithms (ALM) over ALK algorithms again. This time 5 out of 10 available 
ALM algorithms have found the optimum, but AS achieved a result only 0.01% worse 
than the optimum. The best ALK, namely Lin-Kernighan achieved 99.70% of the 
optimum, which is quite a good result. Other ALK algorithms achieved only 88% of 
the optimum value (Fig. 12.4). 
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The diagram of algorithm effectiveness for solving eilSt problem 
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Fig. 12.3 Graphical representation of the results for the problem Eil51 


The — of algorithm effectiveness for solving d198 problem 


100% T xx na j 


nm 
TT G, 0t A Z $ 1o00% 
> noO o os 
Ni 7 L nS 


Optemum 


16399 eors somo 18203 


TE 


Rate weg The cercertinge d oiran amen 


The percentage of optimum fulllement 


Graphic representation of the problem 


Fig. 12.4 Graphical representation of the results for the problem D198 


Pcb442 represents the problem covering 442 towns. It is the hardest problem thus 
far, because only 3 out of 10 tested algorithms, BWAS, EAS, and ACS have found 
the optimum. MMAS missed the best solution by only 0.01%. Leading algorithms as 
regards this problem also include, respectively: ASRK with the result of 99.79%, AS 
99.64%, and LK 99.43%. As can be noted, 3 ALM algorithms achieved optimum, 
one missed the optimum by the skin of its teeth, then, two further ALM algorithms 
achieved very good results and, again, the best of the ALK algorithms, that is, LK was 
the last on the list. The remaining ALK algorithms performed even worse than for the 
problem with 318 towns and achieved from 80 to 87% of the optimum (Fig. 12.5). 

Rat783 represents the problem covering 783 towns. In this case 3 algorithms 
achieved optimum solution, namely EAS, MMAS, and ACS; BWAS missed the 
optimum solution by 0.02%, and ASRK missed it by 0.07%. For the first time we 
have the situation where the ALK algorithm, that is, LK with the score of 99.72% 
outdistanced a representative of ALM algorithms, the AS algorithm with the score 
of 99.69%. Other ALK algorithms were unrivaled (Fig. 12.6). 

Pr2392 The last of the 10 presented problems was also the biggest one as it 
included as many as 2,392 towns. There is no doubt that the bigger the problem is, the 
worse the solutions. The first four places on the list were taken by ALM algorithms, 
where ACS was the best with the score of 99.59%. One of the ALK algorithms, 
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Fig. 12.5 Graphical representation of the results for the problem Pcb442 
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Fig. 12.6 Graphical representation of the results for the problem Rat783 


namely LK, was fifth on the list with the score of 98.63%. Two subsequent places 
on the list were taken by ALM algorithms, that is, by EAS with the score of 98.39% 
and by AS with the score of 97.80%. The remaining ALK algorithms followed the 
trend of worse solutions and with the increased problem complexity they achieved 
from 79 to 85% of the optimum. 


12.6 Summary and Conclusions 


Having performed a number of experiments according to the rules specified above, 
one can be certain about the superiority of ant colony algorithms over classical algo- 
rithms (Fig. 12.7). There was only one case out of 10 studied samples, where the 
Lin-Kernighan (LK) algorithm achieved better results than all other known meth- 
ods, including ant colony methods. This could have resulted from the nature of the 
problem, that is, nrw1379. In that case the results obtained by the LK algorithm were 
only slightly worse than the results of the OFNAnt algorithm. For the remaining files, 
the LK algorithm outpaced, at best, only older ant colony methods, AS and EAS. 
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Fig. 12.7 Graphical representation of the results for the problem Pr2392 


The remaining algorithms from the group of heuristic methods performed definitely 
much worse than the leading algorithms. They fulfilled the optimum solution within 
the range from 79 to 89%, which is far from the results of the leading algorithms. 
The noticeable feature of the studied group of algorithms is their tendency for worse 
results with the increase of problem magnitude. A clear example of that tendency is 
the seventh tested problem, pcb1173. This statement is confirmed by problem d1291 
and further large datasets. The diagram presented above, which summarizes all per- 
formed tests, shows the hierarchy of all algorithms and their respective scores. The 
maximum available score is 1,000 points. The scores closest to the maximum were 
achieved by representatives of ant colony algorithms, including OFNAnt with the 
score of 999.31 points. Itis worth noting that the first four places on the list of optimum 
solution searching efficiency are taken by ant colony algorithms. Subsequent places 
on the list are taken by representatives of heuristic methods with their definite leader, 
the LK algorithm, which is widely regarded as one of the best methods for solving 
the traveling salesman problem. Ant colony algorithms represent a new generation 
of optimizing algorithms using a metaheuristic approach to NP-hard problems, the 
approach that gave excellent results. Ant colony algorithms find many more appli- 
cations other than TSP. Those applications include many real-life fields. Based on 
the results of experiments with the new method using trend and fuzzy logic, one can 
also expect obtaining interesting solutions for problems other than those where ant 
colonies have already been successfully applied. The new method, OFNAnt, which 
is a hybrid combination of ACO and OFN, and introduces fuzzy decision of an ant, 
is the first known attempt to implement the arithmetic of Ordered Fuzzy Numbers to 
ant colony optimization. Performed experiments confirmed efficiency of that method 
in solving TSP problems. Currently, there are ongoing works on application of the 
modification of that method for solving problems of other classes. 
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Chapter 13 

A New OFNBee Method as an Example of 
Fuzzy Observance Applied for ABC 
Optimization 


Dawid Ewald, Jacek M. Czerniak and Marcin Paprzycki 


Abstract The chapter includes a hybrid concept combining bee colony optimization 
with the application of Ordered Fuzzy Numbers. This is another research, after the 
OFNAnt method, prepared in AIRlab - Artificial Intelligence and Robotics Lab- 
oratory at Kazimierz Wielki University in Bydgoszcz, in which authors enriched 
metaheuristics by implementing the arithmetics of Ordered Fuzzy Numbers (OFNs). 
Applied fuzzy observation enabled very faithful modeling of the navigation mecha- 
nism used by bees when orienting with reference to the position of the sun. Experi- 
ments aimed at verification of the developed concept have been carried out on a set 
of several commonly known benchmarks. The preliminary results of experiments 
allow us to nurture grounded hope that further modifications of the metaheuristics 
using OFN arithmetics shall enable smooth control of the optimization criteria of the 
tested phenomena. 


13.1 Introduction 


Swarm intelligence is a relatively young branch of artificial intelligence. Its begin- 
nings are usually pinpointed in the early 1990s of the past century. At that time 
Marco Dorigo published his doctoral thesis concerning ant colony systems. After 
studies on ants, articles related, among others, to termite hills have appeared [11, 
43]. Not only insects became the inspiration for researchers interested in “social 
algorithms.” Indeed, common interest is aroused by V-formations of birds, shoals of 
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fish, or plankton and locust swarms. Studies on bivalves and their use in water intake 
purity assessment systems are also very interesting. As regards those inspirations, the 
beginning of the twenty-first century undoubtedly belongs to bees. The bee swarm 
optimization algorithms make up a collection of algorithms inspired by the behav- 
ior of honeybees [34, 35]. Observations performed as early as the mid-twentieth 
century by the German zoologist Martin Lindauer, who published his study in 1950 
are usually regarded as the first ones [30]. Lindauer noted that bees returning to the 
swarm with food perform a sort of “dance.” Thanks to further observations, Lindauer 
concluded that only a small percentage of bees participate in making a decision on 
changing to the new food source. Most bees do not participate in the foraging but 
wait for the decision to be made by the “dancing” bees, who gradually reduce the 
number of proposed sources. When a single location is finally selected, most of the 
bees rise to fly towards the selected food source. Further entomologists proved the 
theory on the meaning of the dance performed by the bees. They gave incontrovert- 
ible proof that a scout bee returning to the hive uses its dance and pheromone to 
provide information allowing the swarm to figure out the type of food it met. Bees 
navigate by the sun, therefore the first theory that has been proven was the fact that 
the angle of the bee body is indicative of the direction of flight relative to the sun. 
Next, the information is carried by the amplitude of the individual’s vibrations as it 
is directly proportional to the abundance of the food source, and the length of the 
movement in a given direction informs the observer about the necessary length of 
the flight. There are three types of dance used by bees to depict the distance to the 
food: 


e Round dance: When a food source is near the hive 
e Flourish dance: When that distance exceeds 100m 
e Crescent dance: When the distance is something between near and 100m 


Figure 13.1 presents the dancing bee and the method of reading the submitted infor- 
mation (Fig. 13.2). 


Fig. 13.1 The dance used by bees to depict the distance to the food 
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Fig. 13.2 Navigation by the 
sun 
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On the basis of entomologists’ studies, one can also conclude that the dance 
process is a way of reconciling the opinion of bees on the new location of food, a kind 
of voting. However, that hypothesis included some inconsistencies, as sometimes 
bees rose to fly despite the absence of unanimous decision of dancing bees and as 
the way of voting for dancing bees by other bees could not be observed. This caused 
formulating and attempting to prove two new hypotheses: a quorum hypothesis, 
whereby the voting in which the majority of the bees voting for a given nest is 
sufficient and a consensus hypothesis, denoting agreement of some group of dancing 
bees. On the basis of experimental studies scientists have managed to exclude the 
consensus hypothesis, whereas the quorum hypothesis has been confirmed. It turned 
out that, after reaching the quorum, the scout bees returned to their group at the 
same time creating the characteristic sound received by the remaining bees which 
stimulated them to warm up their muscles. This warm-up usually took about an hour 
and immediately after it bees flew to a new source of food (Fig. 13.3). 

The behavior of bees when selecting a new nest can well be used for a decision 
made by any group. Thanks to three factors defined by scientists studying behavior 
of bees, such a decision shall always be correct (Fig. 13.4). 


1. Organization allowing knowledge sharing by the entire group. It is much easier to 
make proper and unanimous decisions thanks to a large number of objects taking 
part in the decision-making process and correct distribution of knowledge among 
the objects. 
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Fig. 13.4 The dance angle indicates the angle of navigation with regard to the sun 


2. The competition, thanks to which every object tries to improve at any time. The 
more good objects, the easier and quicker the decision-making process can be. 

3. Balance, which is defined as making a decision on the basis of the opinion of many 
objects, keeping to the democracy rules at the same time. As aconsequence, wrong 
decisions do not influence the final decision. 


13.2 ABC (Artificial Bee Colony) Model 


The artificial bee colony (ABC) is a model proposed in 2005 by the Turkish scientist 
Dervis Karaboga. As with other algorithms described herein [12, 13, 26, 28, 29, 32, 
33], ABC is also based on the swarm behavior of honey bees. It differs from other 
algorithms in the application of a higher number of bee types in a swarm [10]. After 
the initialization phase, the algorithm consists of the following four stages repeated 
iteratively until the number of repetitions specified by the user is executed [4, 18-20] 
(Fig. 13.5): 


e Employed bees stage 
e Onlooker bees stage 
e Scout bees stage 

e Storage of the best solution thus far 


The algorithm starts with initialization of the food source vectors Zm where m = 
1,..., SN and SN, ..., is the population size. Each of those vectors stores n values 
Xm, i = 1,...,n, that shall be optimized during execution of that method. The vectors 
are initialized using the formula: 


Xmi = l; + rand(0, 1)- (u; — li) (13.1) 


where l; is the lower limit of the searched range, and u; is the upper limit of the 
searched range. 
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Fig. 13.5 The dance 
duration is proportional to 
the length of the flight 


Bees adapted to different tasks participate in each stage of the algorithm operation. 
In the case of ABC, there are three types of objects involved in searching [3, 19, 21]: 


e Employed Bees: Bees that search points near points already stored in memory 

e Onlooker Bees: Objects responsible for searching the neighborhood of points 
deemed the most attractive 

e Scout Bees (also referred to as scouts): Bees that explore random points unrelated 
in any way to those discovered earlier 


Once the initialization phase is completed, Employed Bees start their work. They are 
sent to places in the neighborhood of already known food sources to determine the 
amount of nectar available there. The results of the Employed Bees’ work are used 
by Onlooker Bees. Employed Bees randomly select a potential food source using the 
following relationship. 

Ti = Xmi + Omi Xmi + Xki) (13.2) 


where y, is a vector of potential food sources, x; is a randomly selected food source, 
and Øn; is a random number from the range [—a, a]. 

Once the vector is determined, its fitting is calculated based on the formula depen- 
dent on the problem being solved and the fitting Tn is compared with S m. If the 
new vector fits better than the former one, then the new one replaces the old one. 

Another phase of the algorithm operation is the Onlooker Bees stage. They are 
sent to food sources classified as the best ones and in those very points the amount of 
available nectar is determined. The probability of the source selection is expressed 
with the formula: 

Sitm (È m) 


1 13.3 
SN Sita? n) Ha 


Pm = 


where fitm (È m) is the value of fitting functions for a given source. 
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Obviously, when Onlooker bees gather information on the amount of nectar, such 
data are compared with results obtained thus far and if the new food sources are better, 
they replace the old ones in memory. The last phase of this algorithm operation is 
exploration by Scouts. Bees of that type select random points from the search space 
and then check nectar volumes available there. If newly found volumes are higher 
than the volumes stored thus far, they replace the old volumes. The activity of those 
bees makes it possible to explore the space unavailable for the remaining types of 
bees thus allowing omitting any extremes. 


13.3 Selected OFN Issues 


There are researchers who focus on certain aspects of fuzzy logic application in 
artificial bee colony optimization. Their articles are literally related to Zadeh’s fuzzy 
sets and the fuzzy number arithmetics arose from them chronologically. Combining 
the Ordered Fuzzy Numbers (OFNs) with artificial bee colony optimization has not 
been proposed thus far. Articles describing such a hybrid approach to optimization 
tasks using ant colony algorithms are named OFNAnt [5, 6, 8, 31]. 

Basic research on many aspects of OFNs has been published in many papers of 
the creator of this concept, W. Kosinski [14, 23-25, 39, 40], and of a broad group 
of researchers who cooperated with him in this field of science [1, 7, 10, 15-17, 22, 
27, 42] 

[2, 9]. However, it is not the purpose here to cite the well-developed and well- 
known deliberations on the OFN, which, in some of the new articles, are also known 
as Kosinski’s fuzzy numbers (KFNs) [36-38, 41]. 


13.4 New Hybrid OFNBee Method 


Application of OFN notation in artificial bee colony optimization seems to be a 
completely natural way to describe the behavioral mechanisms observed in a hive 
and mentioned above. The input data are pieces of information carried by a single 
bee: 


The direction to the food location 
The angle of navigation by the sun 
The flight length 

Abundance of the food source 


Figure 13.6 shows the OFN describing information delivered by a Scout bee: 


e aF: Angle between the sun and the food source 
e sF: Food quantity 
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Fig. 13.6 OFN describes the 
information from a scout bee 


e dF: Distance to the food. Figure 13.6a shows the food that has to be reached 
by flying at the aF angle in relation to the sun’s position. Figure 13.6b includes 
selected information containing this angle. The arm with the symbolically marked 
bee represents the distance to food d F, and the amplitude of vibrations marked 
with a sine wave reflects the amount of food sF. An Ordered Fuzzy Number 
is determined as follows. First support(A) is determined, which is the base of 
the trapezoid. Then the rising edge f(x) is drawn at the angle of 90° — a F. The 
second base of a trapezoid is laid off from the point in which the function f(x) 
intersects with y = 1. At the end one has just to connect two ends of the trapezoid 
bases using the falling edge function g(x). Consecutive steps are presented using 
a pseudocode: Pseudokod ABC: 


1. Initialize the population of solutions x; ;. 
2. Evaluate the population. 

3. 
4 
5 


Cycle = 1. 


. Repeat. 
. Produce new solutions (food source positions) v;,; in the neighborhood of x;, ; 


for the employed bees using the formula v; ; = xij + bij (Xij — Xx,;) (k is a 
solution in the neighborhood of i, and @ is a random number in the range 
[-1,1]) and evaluate them. 


. Apply the greedy selection process between x; and v;. 
. Calculate the probability values P; for the solutions xi by means of their fitness 


values using the Eq. 13.4 


fit; 
i=1 t 
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In order to calculate the fitness values of solutions we employed the Eq. 13.5: 


1 ‘ 
fit; = 1+ abs(f) Faa (13.5) 


Normalize P; values into [0,1]. 
8. Produce the new solutions ?; for the onlookers from the solutions x;, selected 
depending on P;, and evaluate them. 
9. Apply the greedy selection process for the onlookers between x; and v;. 
10. Determine the abandoned solution (source), if it exists, and replace it with a 
new randomly produced solution x; for the Scout using the Eq. 13.6 


xij = min; + rand(0, 1) x (max; — minj). (13.6) 


11. Memorize the best food source position (solution) achieved thus far. 
12. Cycle = cycle + 1. 
13. Until cycle = maximum cycle number (MCN). 


13.5 Experimental Results 


This section includes results of our own tests solved using the OFNBee algorithm. Ten 
calculations were performed for each of the three optimization problems described 
below. Average values were calculated from the obtained results and then compared 
with results available in the literature for the classic ABC algorithm. Program settings 
for individual problems are presented in Table 13.1. where individual abbreviations 
mean, respectively: 


e Number of populations: NS 
e Number of iterations: MC 
e Change rate: MR 

e Scout generation time: SPP 


For the first tested problem, the welded beam, the best results for program settings 
were obtained by the classic ABC algorithm and are shown in Table 13.2. The fillet 
weld width is defined by the variable x1, and x2 is the parameter defining the weld 
length, x3, the beam height, and x4, the beam width. After listing and comparing 
the results obtained using OFNBee and the classic ABC algorithm, one can notice 
that the solutions are similar. The result of the experiment for the objective function 
differs from the second decimal place which confirms repeatability of good results 
(Fig. 13.7). Another problem tested in the experiment is the pressure vessel problem. 
The wanted variables are shown in Fig. 13.8. The aim of this experiment is to mini- 
mize the total material costs of the cylinder and its welding. Solutions found by the 
ABC algorithm for this problem for given program settings are shown in Table 13.3. 
Comparing the experimental outcomes with the results available in the literature one 
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Table 13.1 Program settings for the tested design problems 


Problem NS MC MR SPP 
Welded beam problem | 30 1000 0.9 400 
Pressure vessel problem | 30 1000 0.9 400 
Speed reducer problem | 30 1000 0.9 400 
Spring compression and | 30 1000 0.9 400 
tension problem 


Table 13.2 Parameters and Experimental Results available 
value limits of the best results in the literature 
solutions obtained for the 
welded beam problem xl 0.1822 0.0057 

x2 4.061 3.4705 

x3 9.0319 9.0366 

x4 0.206 0.2057 

glx) —0.404 0 

g2(x) — 17.7028 0 

g3(x) —0.0238 0 

g4(x) —3.3793 —3.4329 

g5(x) —0.0572 —0.0807 

g6(x) 0.2355 —0.2355 

g7(x) —27.1433 0 

f(x) 1.766 1.724 


can notice that there are no significant differences for variables from x 1 to x3 whereas 
for variable x4 a bigger difference occurs which may significantly impact the final 
objective of the problem. However, for relatively large limits of the variables, the 
experiment result is satisfactory. In the speed reducer optimization problem, its mass 
is minimized. The test results for that problem are given in Table 13.4. In this case 
seven variables are subject to limitations, as shown in Fig. 13.9. The variables define, 
respectively: x 1, surface width; x2, teeth pitch module; x3, number of teeth of a gear; 
x4, length of the first shaft between bearings; x5, length of the second shaft between 
bearings; x6, diameter of the first shaft; and x7, diameter of the second shaft. 

After listing and comparing the results one can notice that there are only very 
minor deviations for individual variables. In this problem, the objective function 
differs very little from the results available in the literature. That may be caused by 
narrow intervals of the variables and numerous limits for the function. 
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Fig. 13.7 Welded beam 
optimization problem 


Fig. 13.8 Pressure vessel x, 


| X2 
optimization problem i 
x X3 


Table 13.3 Parameters and 


ane imiisotte best Experimental Results available 
solutions obtained for the — ee 
pressure vessel optimization 0.875 0.8125 
problem *1 
0.4375 0.4375 
x2 
44.4316 42.0985 
X3 
149.7213 176.6366 
x4 
—0.0174 0.0000 
gi(x) 
—0.0136 —0.03588 
g2(x) 
—0.3373 —0.00003 
g3(x) 
—90.2786 —63.3634 
84x) 
6196.47 6059.714 
fœ) 
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Table 13.4 Parameters and 


aa Experimental Results available 
value limits of the best results in the literature 
solutions obtained for the 
speed reducer problem p 3.4999 3.4999 
1 
0.7000 0.6999 
X2 
17.0000 17.0000 
X3 
7.3000 7.3000 
X4 
7.8000 7.8000 
x5 
3.3502 3.3502 
x6 
5.2877 5.2872 
x7 
—0.0739 —0.0739 
g(x) 
—0.1979 —0.1979 
82(x) 
—0.4992 —0.4991 
83(X) 
—0.9015 —0.9015 
g4(x) 
0.0000 0.0000 
gsx) 
0.0000 0.0000 
86(X) 
—0.7025 —0.7025 
87(X) 
9.9E-13 —0.0001 
gg(x) 
—0.5833 —0.5833 
89(X) 
—0.0513 —0.0513 
810(X) 
—0.0106 —0.0106 
B11 (x) 
2997.058 2996.783 
fœ) 
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Fig. 13.9 Speed reducer 
optimization problem 


13.6 Conclusion 


The structure of the ABC solutions allows adjusting the algorithm very freely to the 
newly raised problem. This makes it very useful in solving multiobjective optimiza- 
tion problems. Its second important feature is the algorithm’s fast operation. Thanks 
to the modification that consists in application of the Ordered Fuzzy Numbers to 
determination of the objective function, the obtained result is of better quality. The 
algorithm operation time has improved as well. It should be noted that in each of the 
three analyzed benchmarks (tested problems), the results obtained using the OFN- 
Bee algorithm are at least as good and often better than without the modification. 
The authors analyzed the welded beam optimization problem, pressure vessel opti- 
mization problem, and the speed reducer optimization problem. The results of the 
conducted experiments are presented in Tables 13.1, 13.2, and 13.3. In the future, we 
plan to extend the field of OFN application to the calculations in several artificial 
bee colony algorithms. We expect that it could give some interesting results. 
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Chapter 14 
Fuzzy Observation of DDoS Attack 


Lukasz Apiecionek 


Abstract DDoS attacks are able to block Web servers. Such attacks could be started 
from anywhere in the network. This chapter presents the possibility of using Ordered 
Fuzzy Numbers (OFNs) for observation of a DDoS attack. The proposed algorithm 
could be implemented on routers and predict the moment of the attack. Such predic- 
tion gives a possibility for the network administrators to protect server resources. In 
the chapter the author presents the real test results made on a prepared IP network. 


The presented results prove that OFNs have a huge potential for usage in observation 
of DDoS attacks. 


Keywords DDoS - Security » Fuzzy logic - Fuzzy observation 


14.1 Introduction 


Today the main network used is the Internet which could be described as a wide 
area network (WAN). Many huge companies have many offices in different locations 
connected to the Internet. In this situation often some virtual private networks (VPN) 
are created to connect the locations in a secure way. This gives a possibility to block 
the company using a distributed denial of services (DDoS) attack on such systems. 
Such an attack could block the server from managing connections and thus resources 
and could generate financial loss for this company. That is why this problem is very 
common and should be solved. 
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14.2 DDoS Attack Description and Recognition 


These attacks are well described in the literature [1-3]. There are many possible types 
of such attacks. One of them could use TCP/IP sockets vulnerabilities [2, 4], whereas 
others could use domain name system (DNS) server vulnerabilities. As mentioned, 
the main principle of such attacks is to try to utilize all server resources by generating 
a lot of ordinary user connections. The number of such connections can exceed the 
servers’ capability to handle them. Many papers [1-3, 5, 6] provide methods for 
dealing with DDoS attacks. These methods could be described as detection and the 
necessary cooperation between network providers. This is because the attackers send 
their packets through the network which belongs to a network provider. Therefore 
only network providers can block the attacker traffic. If they do not block such traffic, 
that traffic will saturate data links. This saturation causes blockage of the connection 
to the server [7] which could block some valuable portals such as e-learning plat- 
forms [8, 9]. Some of the methods for detecting DDoS attacks use general- purpose 
computing on graphics processing units [10], whereas others recommend protect- 
ing networks with a firewall [11, 12]. Intrusion prevention systems and intrusion 
detection systems use huge databases that consist of data collected during simple 
attacks from one place on the network [11]. But detecting attacks in a real worldwide 
network, such as a WAN, is a very complicated process. Some authors claim that it 
could be ensured by cooperation of routers, firewalls, and Internet providers [13-15]. 
Other possibilities include the use of fuzzy logic for this purpose [16, 17]. Such a 
solution requires a great deal of effort from experts who have to provide the rules 
describing the possible attack. Then, these rules are used for attack observation. 


14.3 The Idea of Attack Recognition and Prevention 


The proposed idea of attack observation, for recognition and prevention, is to limit 
performance of a network device during the attack that will limit the number of 
connections made to the target of the attack. Nowadays there are methods for limiting 
incoming traffic on a firewall and they allow the servers to deal with the already 
established connection. This should let the users finish their work and enable new 
users to connect to the server. Such known methods are quality of service (QoS) 
methods. QoS methods let the network administrators limit data traffic that could be 
described by many parameters such as source address, destination address, protocol, 
port, and so on. This solution also makes it possible for the router to count incoming 
traffic and decide which packet will be transferred as first and which will be the last. 

There are some papers describing the QoS method idea that can work on one router 
and try to protect network resources locally [18]. But this solution does not recognize 
the source of the attack and does not solve the problem. When the packets are not 
blocked the hacker is still able to send packets to the server and block its resources. 
Nowadays routers are, of course, exchanging a lot of information between them. 
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The main information describes the reachability of the IP networks. This is done by 
routing protocols such as OSPF, EIGRP, BGP, or multicast routing protocols [19, 20]. 
This mechanism can be used for recognizing the DDoS attacks with some Ordered 
Fuzzy Numbers (OFNs) implemented. As has already been mentioned, QoS methods 
are able to count the number of packets, but they are not able to decide if the packet 
is part of a DDoS attack on a server. There is a need for new services for network 
providers. Those services should provide mechanisms for detecting the attackers’ 
packets to enable the router to block them on all the network routers, not only on 
the firewall that operates in front of the target of the attack. Such services should be 
implemented in an easy way, and it should use some well-known mechanism such 
as exchanging information between routers via routing protocols. Such a solution 
is the simple network management protocol (SNMP) which is used for acquiring 
knowledge on traffic statistics. The solution proposed by the authors for recognizing 
DDoS attacks using OFNs could be implemented on routers and require collecting 
traffic statistics. This method should not utilize too many resources of the routers, 
therefore it should also cooperate with the possible target of the attack. The author 
defines this method in the following steps. 


Server collects information about its traffic statistics (1) via SNMP from network 
routers. 

Using OEFNs, its traffic statistics, and operating status, the server detects that it is 
under attack (2). 

Server establishes IPSec channel to network provider’s router (3). 

Server passes information about the type of traffic that has to be blocked by the 
network using SNMP over the IPSec channel (4). 

Router starts to block specific traffic (5). 

Router spreads the information about specific traffic that has to be blocked via a 
SNMP trap message to other routers (6). 

The specific traffic of the attacker is blocked via the network resources (7). 


These steps are presented in Fig. 14.1. This idea is very simple and can be imple- 
mented very easily. The proposed algorithm uses SNMP and IPSec encryption. Some 
known aspects of the attack are used. The first is that the target of the attack is a server. 
The consequence of that fact is that the server should recognize it is under attack. 
The network alone is not able to decide if the server is under attack. Second, if the 
routers get the information that they have to block some specific traffic, they could 
do it. Routers could block specific traffic to the server using an already implemented 
mechanism such as random early detection. The process of passing the information 
from the server to the router that there is an attack has to be protected and both sides of 
the communication have to be authenticated. This could be achieved using a second 
already existing mechanism such as IPSec encryption and public-key infrastructure. 
Nowadays many organizations possess X.509 certificates signed by authorized certi- 
fication authorities. The aforementioned secure communication channel, established 
by IPSec, could be used for passing the information from the server to the router that 


242 L. Apiecionek 


Web Server 
IP 1.1.1.1 


es (1) Collecting traffic statistic 
= (2) Attack recognition using KFN 


(5) Blocking specific 
traffic 

(6) SNMP trap 
about traffic to 
block 


(3) IPSec channel establishing 
(4) Information passing about the attack via SNMP 
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the attack 


Fig. 14.1 The algorithm concept 


the server is under attack. This message can also include information about the kind 
of traffic to be blocked in the network. There could also be SNMP used in a secured 
IPSec channel to pass the information. As mentioned, SNMP is also widely imple- 
mented on routers. Thus the network providers can implement this solution on their 
routers. The only thing that has to be done is to decide if the server is under attack. 
This process could be achieved using the aforementioned Ordered Fuzzy Numbers. 


14.4 Attack Observation Using OFNs 


As has already been mentioned, the system administrator has the possibility to check 
how many and which users are already connected to the server. He or she is also a 
person who possesses the knowledge about the prime time of the day in which users 
usually work with the system. Another issue that could be checked is how many TCP 
SYN connections actually come to the server by attempts to establish a TCP session. 
The last area that could be checked by the proposed algorithm, as mentioned before, 
is router statistics of packet transmission. That complete set of information should 
be enough to decide whether the server is under attack. In the proposed algorithm, 
the administrator will not use the fact that the number of connections is growing. 
The method will measure the packet count during network operation based on router 
statistics provided by SNMP. In the proposed algorithm, the administrator should 
measure The specific packet count four times: 
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Fig. 14.2 Fuzzy number in 
OFN notation 


= pal(x) 


> 

0 2 { 6 8 10 
fa(0) fall) gall) gal0) 
tis tiz tis ti 


ti, ti—1), ti-2), ti—3) (14.1) 
where t; is a current timeslot. 
All four measures together give a fuzzy number in OFN notation where 


e fa(0) corresponds to ta-3) 
e fa(l) corresponds to ta-—2) 
e g4(1) corresponds to ta-—1) 
e g4(0) corresponds to t; 


This fuzzy number in OFN notation is presented in Fig. 14.2. This is a definition of 
fuzzy observance of a router. 


Definition 1 Fuzzy observance of an R router in time t; is a set 


R/ti = {fr@)/ti-3, frQ)/ti-2, g&r(1)/ti-1, gr(0))/ti} (14.2) 
where 
ti > 1 > ti—2 > b31 


lt — tizi] = |4-1 — ti-2| = |ti-2 — ti-3| = ty, timeslot of the measurement 
frO) < fr) < gr(1) < gr) 


This provides Lemma 1. 


Lemma 1 
fr) < fr) < grQ) 
R positive = or (14.3) 
fra) < gr(1) < gr(O) 


in other situations, Rnegative- 
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Fig. 14.3 The algorithm concept 


According to this definition during router observance the counters should give: 


e Positive order of OFNs when the packet count increases 
e Negative order of OFNs when the packet count decreases 


The interpretation of these orders is presented in Fig. 14.3. Then the statistics col- 
lected on the routers are prepared and the appropriate counters give the results for 
preparing fuzzy numbers, and a fuzzy observance of the group of routers can be 
defined. Fuzzy observance of the group of routers is defined as 


Definition 2 Fuzzy observance of the group of routers is described by the formula: 


n 
— R positive | Rnegative 
sara, l uaa 


i= 
where w; € {w;,..., Wn} describes an impact on all routers. 


This provides a possibility to define the situation when DDoS should be detected on 
the router: 


Definition 3 An attack on the router is detected in the following conditions: 

If Ri is positive AND Ri is negative THEN Attack = true 

where Ri is an order from the history of statistical results according to that router on 
the time of day of the observance. 


According to this, the situation when DDoS could be detected on a group of routers 
could be defined as follows. 


Definition 4 An attack on a group of routers is detected in the following conditions. 
If Sm is positive AND Sm’ negative THEN Attack = true 

where Sm is an order from the history of statistical results according to that group 
of routers on the time of day of the observance. 
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14.5 Experiment Test Results 


In the following two subsections we provide descriptions of the test together with 
the results of attack detection by the proposed method. 


14.5.1 Test Description 


To test and prove the idea a special IP network was prepared. This test was inspired 
by the situation in Poland, when the Polish government attempted to sign the ACTA 
regulations. This situation caused a huge attack on Polish government websites. In 
consequence, those websites were blocked. The method of attack was very simple, 
because it was sufficient that many people tried to visit such websites which generated 
massive traffic to the servers. These servers were not prepared to manage so many 
connections exceeding their capacity. Finally the servers stopped responding to users’ 
queries. Such a method of attack could be simulated in an easy way. Some simple 
tools could be found on the Internet [21]. One of them is DDOSIM, Layer 7 DDoS 
simulator [22]. This solution is provided with the source code, thus it is possible to 
analyze it and check how it works. In a real situation, the attacker has to collect an 
appropriate number of hosts that could be used as sources of the attack. Once she has 
them, the attack can be started. In the prepared simulation, it is enough to just run the 
DDOSIM program with the appropriate parameters. After that, this tool will generate 
the defined amount of connections to the defined IP address. To perform this test a 
special network with mesh topology (shown in Fig. 14.1) was prepared. The user 
hosts labeled from 1 to 5 were running DDOSIM software in the appropriate cycle. 
This station was equipped with an Intel i3 processor running under Windows 7 64- 
bit system control. But the DDOSM software was running on a virtual machine in a 
VMWare environment. That virtual machine was equipped with 512 MB of memory 
and 1 processor and was running under Debian operating system control and the Web 
server was equipped with two Intel Xeon processors with a Windows 2008 server 
operating system. An Internet information service was started on the Web server. 
It was used to provide an HTTP server functionality. The routers R1 to R6 were 
Cisco 2600 series routes. To simulate the attack the DDOSIM software requested 
information from the Web server using a TCP connection in the following steps. 


e User sends TCP SYN packet to port 80. 
e Web server answers with TCP SYN ACK and reserved resources. 
e User sends TCP ACK packet. 

e User sends HTTP/GET as a request for information packet. 

e Server attempts to answer this request for information packet. 
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The cycle of simulation was prepared in the following steps and according to the 
following conditions. 


The IP address of the Web server was 192.168.10.12. 

The user hosts from 1 to 5 have got IP addresses 192.168.x.4, where x belongs to 
the set 1, 2, 3, 4, 5. 

During the attack the packets were sniffed using Wireshark; there were six places 
where packets were sniffed: user 1 to 5 machines and the Web server. 

The network was running normally. 

After 1 min of normal operation the host of user 1 started the attack. 

The target of the attack, of course, was the Web server. 

The user machines were sending request packets using DDSOIM software with 
these parameters: there were 1,000 HTTP GET messages passed to the Web server 
every 30s. 

Another user host joined the attack every minute. 

Once all the user’s hosts started the attack, all of them attacked together for five 
minutes. 

e When the attack stopped, the packets were sniffed for another five minutes. 


This test provides a lot of data from the network node using files with whole IP 
packets from six places of the network. The database from this simulation including 
the traffic from all the connections can be downloaded from data resource page [23]. 
Additional packets that could be recognized in the collected database include the 
open shortest path first routing protocol which was running between routers as in 
ordinary networks [18, 23, 24]. In the network prepared for the simulation, to ensure 
better test conditions, no quality of service method was implemented. Also there was 
no firewall or IDS/IPS implemented in the network whereas it should normally be 
implemented [25-27]. This was because the authors claim that in a real network the 
packets which come from ordinary users are not treated as special packets. Moreover 
the Web servers should not be under any protection in order to check that the method 
of the attack is strong enough and the database collected could be treated as a valuable 
amount of data (Fig. 14.4). 


14.5.2 Attack Detection Using Proposed Method 


Statistics of packets have to be provided to use a proposed method for detecting 
attacks using OFNs. According to the collected database, the results could be cal- 
culated from sniffed packets, and this was done. There is a requirement for defining 
timeslots for which the statistics will be calculated. Those timeslots were defined to 
be one minute. Then the amount of packets directed to the Web server and that pass 
through the routers R1 to R6 was normalized by dividing by 1,000. The achieved 
results of this simulation are presented in Table 14.1. 
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Fig. 14.4 Used network 


Table 14.1 Normalized packets count on routers during test 


Timeslots: 

Router |o lt bh lt lt lt lt lt Itt |t lto |ty [t2 (t3 
RI 0 1 1 1 1 1 1 1 0 0 
R2 0 OS. LS (15 | LS. |15 |15 J15 0 0 
R3 0 0.5 |1 2 2.55 12.5 |2.5 | 2.5 0 0 
R4 0 0.5 |1 1 2 2 2 2 0 0 
R5 0 0.5 |1 1 1:5 (2.5 |2.5 |25 0 0 
R6 0 1 2 3 4 5 5 5 0 0 


To calculate a sum described by Definition 2, the OFNs have to be defined by the 
statistics collected from the routers. In the timeslots tọ the normalized value is 0. It 
means that all numbers are [0, 0, 0, 0]. Thus, accordingly: 


Sin = 0. (14.5) 


This has not got any order, but the results provide the information that there is no 
packet directed to the Web server, therefore there is no attack on it. 

In the timeslot ¢; it is possible to provide the OFN with an approximation. This 
approximation could be made by providing the OFN with only two measurements 
and is utilized as a four-part number by using the values as follows. 


e f,4(0) corresponds to fo. 
e fa(1) corresponds to tọ. 
e g4(1) corresponds to ty. 
e g4(0) corresponds to ft. 
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In this situation the OFN for the routers 1 to 6 could be described as 


e For router R1 it is [0, 0, 1 
e For router R2 it is [0, 0, 0 
e For router R3 it is [0, 0, 0. 
e For router R4 it is [0, 0, 0 
e For router R5 it is [0, 0, 0 
e For router R6 it is [0, 0, 1 
Therefore the Sm = [0, 0, 2.5, 2.5] with positive order. Those results according to 
Definition 4 have to be compared with the historical results in the part corresponding 
to an appropriate day. In the performed simulation the results indicate that the Web 
server is under attack, but the probability of the attack is 50% because the OFN was 
prepared with the aforementioned approximation. In the timeslot f it is still possible 
to provide the OFN only with an approximation. This approximation could be done 
by providing the OFN from only three measurements and used as a four-part number 
by making use of the following values. 


e f4(0) corresponds to tọ. 
e f4(l) corresponds to t. 
e g4(1) corresponds to t2. 
e g4(0) corresponds to fy. 


In this situation the OFN for the routers 1 to 6 could be described as 


e For router R1 it is [0, 1, 1, 1]. 
e For router R2 it is [0, 0.5, 1, 1]. 
e For router R3 it is [0, 0.5, 1, 1]. 
e For router R4 it is [0, 0.5, 1, 1]. 
e For router R5 it is [0, 0.5, 1, 1]. 
e For router R6 it is [0, 1, 2, 2] 


Therefore Sm = [0, 2.5, 6, 6] with positive order. Those results according to Defini- 
tion4 have to be compared with the historical results in the part corresponding to an 
appropriate day. In the performed simulation the results indicate that the Web server 
is under attack, but the situation of the attack could be described with the probability 
of 75% because the OFN was also provided with an approximation. In the timeslot 
tz it is possible for the first time to provide the OFN without any approximation. It 
means that for the OFN four measurement results will be used as follows. 


e f,4(0) corresponds to fo. 
e f4(1) corresponds to tı. 
e g4(1) corresponds to t2. 
e g4(0) corresponds to t3. 


In this situation the OFN for the routers 1 to 6 could be described as 


e For router R1 itis [0, 1, 1, 1]. 
e For router R2 it is [0, 0.5, 1.5, 1.5]. 
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Table 14.2 The sum calculation results 


Time Sum Trend Situation 

to [0, 0, 0, 0] — No attack 

ti [0, 0, 2.5, 2.5] Positive Attack in 50% 
to [0, 2.5, 6, 6] Positive Attack in 75% 
t3 [0, 4, 7.5, 9.5] Positive Attack 

t4 [4, 7.5, 9.5, 12.5] Positive Attack 

t5 [7.5, 9.5, 12.5, 14.5] Positive Attack 

t6 [9.5, 12.5, 14.5, 14.5] | Positive Attack 

t [12.5, 14.5, 14.5, 14.5] | Positive Attack 

tg [14.5, 14.5, 14.5, 14.5] | Positive Attack 

to [14.5, 14.5, 14.5, 14.5] | Positive Attack 

tio [14.5, 14.5, 14.5, 0] Negative No attack 

thy [14.5, 14.5, 0, 0] Negative No attack 

ti2 [14.5, 0, 0, 0] Negative No attack 

t13 [0, 0, 0, 0] Negative No attack 

e For router R3 it is [0, 0.5, 1, 2]. 

e For router R4 it is [0, 0.5, 1, 1]. 

e For router R5 it is [0, 0.5, 1, 1]. 

e For router R6 it is [0, 1, 2, 3]. 


Therefore Sm = [0, 4, 7.5, 9.5] with positive order. Those results, as in previous 
timeslots, have to be compared with the historical results in the part corresponding 
to an appropriate day. In the performed simulation the results indicate that the Web 
server is under attack. Using Table 14.1 the OFN for each router in subsequent times- 
lots was defined and S,, was calculated. Those results are presented in Table 14.1. 
Obviously, the order was described and the decision about a possible attack was 
made. The timeslot of interest is t;0. In this situation the OFN for the routers 1 to 6 
could be described as 


e For router R1 it is [1, 1, 1, 0]. 

e For router R2 it is [1.5, 1.5, 1.5, 0]. 
e For router R3 it is [2.5, 2.5, 2.5, 0 
e For router R4 it is [2, 2, 2, 0]. 

e For router R5 it is [2.5, 2.5, 2.5, 0]. 
e For router R6 it is [5, 5, 5, 0]. 

e All of them with negative order. 


Therefore Sm = [14.5, 14.5, 14.5, 0] with negative order. Those results, as in previ- 
ous timeslots, have to be compared with the historical results in the part corresponding 
to an appropriate day. In the performed simulation the results indicate that the Web 
server is no longer under attack. The same situation could be recognized in timeslot 
tı 1. In this situation the OFN for the routers 1 to 6 could be described as follows. 
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e For router R1 it is [1, 1, 0, 0]. 

e For router R2 it is [1.5, 1.5, 0, 0]. 

e For router R3 it is [2.5, 2.5, 0, 0]. 

e For router R4 it is [2, 2, 0, 0]. 

e For router R5 it is [2.5, 2.5, 0, 0]. 

e For router R6 it is [5, 5, 0, 0]. 

e All of them with negative order. 


Therefore S,, = [14.5, 14.5, 0, 0] with negative order, which means that there is no 
attack recognized (Table 14.2). 


14.6 Conclusions-Method Comparision 


The presented method could be compared with the method proposed in the literature 
as provided in Table 14.3. 

As shown in Table 14.3, the proposed method does not require an expert to define 
the rules of possible attack as in a system with fuzzy logic proposed in some papers 
[16, 17]. Such an expert would have to possess extended knowledge about secu- 
rity and IP networks. This is something that allows us to use the proposed method 
in a very quick way. The second thing is the manner of gathering results of the 
observance of a DDoS attack. In the proposed method, the decision about the attack 
is made using simple calculations provided by the OFN description. This allows 
achieving the results very quickly and easily. The methods found in the literature 
make decisions by comparing a list of rules [16, 17]. Of course there are some solu- 
tions that use mathematical models [28], but they are much more complicated than 
the method using OFNs. The last thing that could be compared is the possibility 
of being implemented in a real environment, which means in real networks. The 
method proposed in the literature requires a lot of processing power. The method 
proposed in this chapter requires only solving a simple mathematical equation. This 
is very important, because it lets us use the proposed method in a real network, on 
real routers. 


Table 14.3 Proposed and existing fuzzy method comparison 


Functionality Existing method with fuzzy Proposed method 
logic 
Method does not require an 


expert to define the rules of the 


Expert work Method requires an expert, 


who has to define the rules of 


the attack 


attack 


Result of DDoS attack 
observance 


Decision made by comparing a 
list of rules 


Decision made by simple 
calculations 


Possibility to implement a in 
real environment 


Requires lot of processing 
power 


Requires only solving a simple 
mathematical equation 
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The presented new concept of detecting DDoS attacks was introduced using fuzzy 


numbers. As has already been mentioned, it consists in determining the server activity 
trend changes by specification of the direction of changes using OFNs. The test was 
performed on the real dataset collected in the prepared network. This dataset is about 
2 GB in size, but the information about the possible attack could be achieved without 
utilizing a lot of CPU performance. 
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Chapter 15 
Fuzzy Control for Secure TCP Transfer 


Lukasz Apiecionek 


Abstract This chapter presents the potential use of fuzzy observance implementation 
for detecting transmission problems that could appear in the near future. Using quick 
detection, appropriate action could be taken and the security and reliability of data 
transfer could be maintained at a high level. As a result the authors present a pro- 
posed solution for dividing a data stream between different data links and predicting 
transmission problems. 


Keywords TCP: Multipath TCP - Security - Fuzzy logic + Fuzzy observation 


15.1 Introduction 


Nowadays many networks require security such as data encryption and reliable trans- 
fer to the destination. Health care, rail, and power plant systems are some examples 
of such systems. When they are used an operator cannot lose a connection between 
his or her control and management applications and system sensors and actuating 
equipment. In such a system a lost connection could have tragic consequences. In the 
case of power plants this could also mean some huge disaster. That is why security 
regarding reliable transfer is very important. In the case of health systems it could be 
required for monitoring people but also for execution of medical operations through 
remote control of medical equipment such as a scalpel. Some problems with rail 
equipment could cause a train accident. There are also many other systems in which 
a lost connection would cause real damage. Such systems are called critical infrastruc- 
ture. For this critical infrastructure more than one connection is usually prepared. 
For example, those systems can operate using cable and a 3G/4G/LTE connection 
concurrently. Unfortunately, in most cases, different kinds of used connections are 
not operated simultaneously. Systems switch between them when the operating con- 
nection collapses. When the systems switch connections they can lose some data. 
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The loss of data can be very costly. In such systems there is much effort concerning 
appropriate data encryption. The systems are usually well protected against unau- 
thorized access to the network [3, 10, 25, 40]. In most cases the data are encrypted 
before being forwarded to the communication transmission layer. The worst situation 
is when they lose their connection, as mentioned above. In order to ensure that the 
data reach their destination, transmission control protocols are used, but it could not 
be enough. When the connection collapses and the system switches to another one, 
the transmission of the lost packet has to be repeated [12, 13, 15]. In many cases, the 
system administrator does not know that use of more than one network connection 
can increase the transfer rate and security level of the data transfer process mentioned 
as reliability of the data transfer. How can it be achieved? In the situation when only 
one connection is used, a hacker can sniff all the packets of data in only one place on 
the network. Thus he or she could collect all the data and then try to decode them. 
After some time the real information can be recovered. When there is more than 
one network connection used, a hacker is forced to work on more spots to sniff the 
packets. More connection used in a parallel way could improve security because in 
this scenario, a hacker must be familiar with more than one transfer technology [11, 
16, 22]. This chapter presents multipath transmission control protocols (MPTCP), 
which is currently ready-to-use technology. This technology can be used to achieve 
the aforementioned functionality. One of the huge advantages of MPTCP is the fact 
that it works at the operating system level. This makes it possible to use the existing 
application in a simple manner. MPTCP are presented with the three schedulers: 
the existing one, some secure proposition, and finally the one using Ordered Fuzzy 
Numbers (OFNs) for fast prediction problems in the transmission [20, 38, 60]. Such 
a presentation lets us introduce OFNs as a ready-to-use solution that could also be 
used in connection with other technology and solve some real problems in IP net- 
works. The chapter is focused on OFN usage in already implemented technology 
such as MPTCP [26, 57, 62]. 


15.2 Multipath TCP 


MPTCP uses the concept of transmission control protocols (TCP) [9, 24, 39, 50]. 
TCP transmission is used for delivering data between applications running on differ- 
ent machines on the network. TCP can be used to send data in both directions between 
two hosts using an established connection. A unique identifier is used to describe 
that connection. That identifier consists of two pairs of values (one for each side of 
the connection), IP and port number [5, 27, 28]. To achieve complete data and their 
appropriate order, checksums and sequence numbers are used. The mentioned data 
are shown in the TCP header presented in Fig. 15.1. When the application intends to 
establish a TCP connection, it has to exchange appropriate signals. This process is 
called a three-way handshake and is presented in Fig. 15.2. Host A sends a segment 
with a set SYN flag, then host B confirms the receipt of the packet and sends back 
SYN and ACK flags as a response. Finally, host A sends an empty segment, with 
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Destination port 


Sequence Number (4 octets) 
Acknowledgment number (if ACK set) 


URG, ACK, 
™ a i 


Urget pointer (if URG set) 


Options 


Fig. 15.1 TCP header 


Fig. 15.2 Three-way SYN 


handshake 
C] 
| ACK | 


HostA HostB 


only the ACK flag as a response to the previous message [34—36, 50]. One possible 
problem with TCP is the process of changing network connections which is associ- 
ated with changing an IP address into another one. When a host switches from an 
Ethernet cable connection to Wi-Fi, it is assigned a different IP address. This triggers 
a process of closing the existing TCP connections and resuming them. MPTCP is 
characterized by a set of extensions to the specification of the existing TCP. These 
extensions enable the client to establish more than one connection while they each 
use different network cards, yet they are all used to reach the same destination host. 
The fact that fault-tolerant and efficient data connections are maintained this way 
between hosts that are compatible with the already used network infrastructures can 
be regarded as a big advantage of MPTCP. A possible way of establishing connection 
using network A and B is presented in Fig. 15.3. Another MPTCP advantage is that it 
increases the throughput of data transfer. This approach should significantly improve 
congestion balance between network paths. Simultaneous enabling of MPTCP must 
not prevent connectivity on a path where regular TCP operates [33, 37, 53, 54]. As 
already mentioned, MPTCP is located at the transport layer and it is intended to be 
transparent to other layers: higher and lower ones, as presented in Fig. 15.4. MPTCP 
can be treated as an additional function of higher layers of the TCP standard. 
When a new connection of MPTCP should be established, a three-way hand- 
shake algorithm of TCP is used. This is presented in Fig. 15.5. The protocol is 
enhanced by a new feature that makes the difference as compared to standard TCP. 
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The MP_CAPABLE option informs both hosts if the MPTCP connection can be 
established and if the data can be transmitted. The IP networks encompass many 
routers and switches working as intermediate boxes. Those boxes could complicate 
the process of establishing connections. For this reason it is insufficient to identify 
the connection pair (IP address and port number) of the source and destination hosts. 
MPTCP has extended TCP functionality by adding another option called MP_JOIN. 
This option is used for generating a new subflow of data. The process of adding a 
new subflow is presented in Fig. 15.6. 
The process of adding a new subflow is done in the following steps. 


e In the first step the MP_JOIN option provides a token generated with the key 
(truncated hash of the key) created during the initial connection. 
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e In the second step the exchange of HMAC (hash-based message authentication 
code) takes place. 

e Inthe third step the subflows are established, and MPTCP can use them to exchange 
data. 


Once the connection is established each host can send data over any of the subflows. 
Furthermore, Fig. 15.7 presents the data transmitted over one subflow. If, for example, 
a packet numbered 4 and 7 is lost it can be retransmitted to another subflow to 
recover the loss. Finally all the data packets reach the destination. There is a ‘subflow 
sequence number’ in standard TCP that supports the reception of a single subflow 
and ensures detection of any data loss. MPTCP uses “data sequence number” to 
sort the received data before passing them to the application [23, 51, 52, 55]. The 
MPTCP header is presented in Fig. 15.8. To inform the destination that the source has 
no more data to send, the source sends “Data FIN” signals. Its operation is exactly 
the same as a TCP FIN in standard TCP implementation. 
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15.3 Multipath TCP Schedulers 


Three schedulers are presented in the next three subsections: standard, secure, and 
with OFN usage. 


15.3.1 Multipath TCP Standard Scheduler 


In general, ordinary users who are connected to the Internet by their smartphones 
via Wi-Fi or a 3G network do not use these connections concurrently. They use them 
in series. The MPTCP is able to use both at the same time as shown in Fig. 15.9. If 
the standard TCP connection fails for some reason, it must be re-established. With 
MPTCP such a situation can be avoided by dynamic switching to the link. Therefore 
the user can avoid wasting time re-establishing connections. It enables the optimum 
data transfer rate selection. 

The first mobile system that supports MPTCP [3, 31, 32, 56] is iOS 7. It ensures 
an uninterrupted transfer in case of failure of one connection or when the connection 
is aborted. At the moment, MPTCP is used in iOS 7 only for transfer of Siri data. Siri 
is an intelligent personal assistant for smartphone users. Such a system of scheduling 
connections was originally proposed by MTCP authors. 


15.3.2 Multipath TCP Secure Scheduler 


Another possible MPTCP scheduler is a secure scheduler. As follows from the lit- 
erature, MPTCP is able to increase the security level of the transmitted data by 
application of many different links to reach the destination. This solution is contrary 
to the present methodology, which is based only on network protection and [1, 2, 
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Fig. 15.10 Mixing data 
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14, 17, 18, 61] on network access control [7, 8, 29, 30, 58]. This scheduler treats 
the transmitted IP packets as raw binary data, which can be divided into blocks and 
then passed to the transmission layer. As regards data protection from being sniffed 
by a hacker, the scheduling algorithm consists of the steps: 


Step 1. Data are divided into blocks. 

Step 2. Data are assigned a special sequence number, data sequence number (DSN). 
Step 3. Blocks are collected in a random sequence. 

Step 4. Data are encoded. 

Step 5. Blocks of data are passed to the MPTCP socket, which will transmit them 
to their destination. 

Step 6. Receiver side collects the blocks of data. 

Step 7. Data are decrypted. 

Step 8. Receiver side connects the blocks of data in an appropriate order. 


The process of dividing the data into blocks, assigning a special DSN (data sequence 
number) to it, and putting it in a random sequence (Steps 2 and 3), is shown in 
Fig. 15.10. Step 5 of the proposed algorithm is presented in Fig. 15.11. The data 
passed to the MPTCP socket is transmitted using different data connections in a 
parallel way. In the vulnerable spots, where the data can be sniffed, a hacker is able 
to get only a portion of transmitted data. These data do not carry any clue as to what 
part of the original data they are [4, 6, 41]. 

The process of mixing the original data blocks uses random sequence and is per- 
formed on the sender’s side, whereas the information about the appropriate sequence 
is passed to the receiver’s side using the DSN. 
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Fig. 15.11 Transmission 
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15.3.3 Multipath TCP Scheduler with OFN Usage 


As already mentioned above, MPTCP can increase network security regarding such 
parameters as a destination reachability and network reliability [42, 43, 48]. For any 
mentioned scheduler, a transmission error can occur at the used channel. The error 
can cause a need for data retransmission over the same channel, or if the number of 
errors grows, the channel can be closed and another connection used. Use of OFNs 
can increase the time of the data transmission link change or can decrease the number 
of retransmissions. OFNs can be used for predicting data loss in the used channel 
and may accelerate the decision on some changes such as quicker retransmission of 
packets or use of a different channel [45—47]. 


15.3.4 OFN for Problem Detection 


An algorithm has been proposed for OFN use for detecting future problems in the 
used connection [19, 21, 44, 49, 59]. For this purpose the algorithm should measure 
a TCP retransmission in all used channels during the transmission as a percentage 
value of transmitted packets (during the given timeslot). This measurement should 
be continuous and statistics should be taken for specific timeslots. Four timeslots of 
a continuous measurement can be defined as follows. 


ti, tG@—1), tG—2), ti—3) (15.1) 


where ft; is a current timeslot. 
All four measurements together make up a fuzzy number in OFN notation where 


fa(O) corresponds to tj_3). 
fa(l) corresponds to ta-—2). 
ga(1) corresponds to t(—1). 
ga(O) corresponds to t;. 
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Fig. 15.12 Fuzzy number in 
OFN notation 


= par) 
> 


0 2 | 6 8 10 
fa(0) faQ) gaQ) ga(0) 


ti-3 ti-2 fis t; 


That fuzzy number in OFN notation is presented in Fig. 15.12. This is a definition of 
a fuzzy observance of a connection. 


Definition 1 Fuzzy observance of C router in time t; is a set 


C/ti = {fe (0)/ti-3, fe)/ti-2, gc) /ti-1, gc O))/ti} (15.2) 
where 


ti > t-1 > ti-2 > b-1 
lt — tiil = |4-1 — ti-2| = |ti—2 — t;-3| = ty, timeslot of the measurement 
fe) < fe) < gc) < gc) 


This provides Lemma 1. 


Lemma 1 
fo) < fe) < ec) 
C positive = or (15.3) 
fe) < gc (1) < ge) 


In other situations Cnegative 

According to this definition, during observance of connections the counters should 
give: 

e Positive order of OFN when the packet retransmission count increases 

e Negative order of OFN when the packet retransmission count decreases 


The interpretations of those orders are presented in Fig. 15.13. Then the statistics 
collected at each connection provide results for fuzzy number preparation. Fuzzy 
observance of the MPTCP connections can also be defined. Fuzzy observance of the 
MPTCP connections is defined as follows. 
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Fig. 15.13 Order interpretation in OFN notation 


Definition 2 Fuzzy observance of the MPTCP connections is defined by the formula: 


n 


— R positive | Rnegative 
sanl eee ; (15.4) 
i= 


where w; € {w;, ..., Wn} describes an impact on all connections. 


This makes it possible to define the MPTCP scheduler with OFNs. 


15.4 OFN Scheduler Algorithm 


An algorithm proposed as OFNs used for transmission error anticipation consists of 
the following steps. 

Step 1. Administrator declares w; and L; for all used connections, where w; describes 
an impact on all connections, and L; describes the load of all data that should be 
sent by those connections when the transmission starts. L; should be provided as a 
percentage value. 

Step 2. The amount of packets P; that will be transferred over each connection for 
each timeslot is calculated using the formula: 


Li 
P; = =, * Data (15.5) 
Ži 


Step 3. During the transmission C; is calculated for each connection according to 
data retransmissions and S; is calculated according to the given definition. 

Step 4. When the calculated S; is positive and exceeds the acceptance level AL, 
there is an error increase detected on this connection. In this situation L; for a given 
connection will be changed according to the formula: 
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Li 


i = = 
ErrorCorector 


(15.6) 


When the calculated S; is negative, there is an error decrease detected on this 
connection. In this situation L; for a given connection will be changed according 
to the formula: 

Li = L; x ErrorCorector (15.7) 


The ErrorCorector is a value that describes how quickly the system should stop 
using a given connection in which the amount of errors has increased. This value 
should also be provided by the network administrator. 


15.5 Simulation Test Results 


To check a MPTCP scheduler with OFNs, some simulations were made. The system 
has got two connection links. Connection 1, labeled C1, was a Wi-Fi connection 
with maximum rate of 11 Mbit/s. The second connection used, labeled C2, was an 
LTE connection with the maximum rate of 5 Mbit/s. The parameters of the algorithm 
were: 


e Corrector for the links ErrorCorector = 2. 

e Acceptance level AL = 3. 

e Load balance at the start for the connection C1 was Lı = 66. 
e Load balance at the start for the connection C2 was L = 34. 
e 60-second timeslots were used. 


The results obtained by the applied algorithm according to load balancing between 
connections during data transfer are presented in Table 15.1. There were errors on 
measured data links and the OFN was calculated according to the presented algo- 
rithm. The number of packets transferred over each link was modified according 
to the level of errors and OFN order. When the percentage of errors increased, the 
number of packets passed to the link with problems (C2) was decreased. Obviously, 
the OFN was calculated after four timeslots. 

Table 15.2 shows the number of packets passed to the connections and the number 
of packets that had to be retransmitted due to an error on the link when the MPTCP 
with and without the OFN algorithm was used. Note that the percentage of errors on 
the C2 link decreased. That is why there were fewer packets transferred during the 
network problems. The number of errors on the C1 connection increased because 
there were more packets transferred through this link. The most important column is 
a sum of errors in both links. When the algorithm decreased the number of packets 
passed through the C2 link, the sum of errors decreased even if the number of errors 
on the C2 link increased. The final results prove that the number of errors in the 
transmission can be decreased using OFNs in the MPTCP scheduler. 
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Table 15.1 Normalized packets count on routers during test 


Time L - load balance % Error on connection |S 
slots 
L1 L2 C1 C2 S1 Order S2 Order 
1 66 34 2 3 Order 
2 66 34 2 3 
3 66 34 2 5 
4 66 34 1 8 [2,1,2,1] | Positive | [3,4,5,8] Positive 
5 66 17 1 12 [1,2,1,1] | Negative | [4,5,8,12] Positive 
6 66 8.5 2 11 [2,1,1,2] | Positive | [5,8,12,11] Positive 
7 66 4.25 2 10 [1,1,2,2] | Positive | [8,12,11,10] Positive 
8 66 2.125 1 11 [1,2,2,1] | Positive | [12,11,10,11] | Negative 
9 66 4.25 2 9 [2,2,1,2] | Negative | [11,10,11,9] Negative 
10 66 8.5 1 8 [2,1,2,1] | Positive | [10,11,9,8] Negative 
11 66 17 1 7 [1,2,1,1] | Positive | [11,9,8,7] Negative 
12 66 34 1 7 [2,1,1,1] | Positive | [9,8,7,3] Negative 
13 66 34 3 2 [1,1,1,2] | Positive | [8,7,3,2] Negative 
14 66 34 3 3 [1,1,2,2] | Positive | [7,3,2,3] Negative 
15 66 34 3 2 [1,2,2,2] | Positive | [3,2,3,2] Negative 


Table 15.2 Number of packets and errors during the transmission 


Time Packet count Error count 
slots 
MPTCP with KFC MPTCP without KFC 
Cl C2 Cl C2 C1+C2 |Cl C2 C1+C2 
1 1872 
2 1616 
3 2416 
4 2704 
5 3792 
6 70870 9128 1417 1004 2421 1056 2992 4048 
T 75160 4840 1503 484 1987 1056 2720 3776 
8 77505 2495 755 275 1050 528 2992 3520 
9 75160 4840 1503 436 1939 1056 2448 3504 
10 70872 9128 709 730 1439 528 2176 2704 
11 63614 16386 636 1147 1783 528 1904 2432 
12 52800 27200 528 816 1344 528 816 1344 
13 52800 27200 1056 544 1600 1056 544 1600 
14 52800 27200 1056 816 1872 1056 816 1872 


— 
Nn 
Nn 
N 
[ee] 
S 
© 


27200 1056 544 1600 1056 544 1600 
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15.6 Conclusions 


The new concept of an MPTCP scheduler using OFNs presented herein was tested 
during a data transfer simulation. As shown in the previous section, with the proposed 
algorithm it is possible to decrease the retransmission count. This could be achieved 
because there were fewer packets transferred over the connection link where some 
problems were detected. This is a potential use of OFNs in a simple way intended 
to improve existing solutions such as MPTCP without complicated algorithms that 
require a great deal of processor capacity. The other advantages of using an OFN 
scheduler are that it could be connected with the presented secure scheduler and 
coexist on the transmissions. Such solutions present the huge potential of OFNs. 
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Chapter 16 
Fuzzy Numbers Applied to a Heat 
Furnace Control 


Wojciech T. Dobrosielski, Jacek M. Czerniak, Hubert Zarzycki 
and Janusz Szczepański 


Abstract This chapter presents a trend phenomenon and application of the fuzzy 
controller for Ordered Fuzzy Numbers (OFNs). The authors propose to use a trend in 
a combustion process for a simplified model of a solid fuel fired furnace. Better con- 
trol over the process translates into reduced CO2 emission as well as optimal use of 
the furnace. When carrying out the fuzzy observation of the efficiency of the furnace, 
the authors apply the OFN notation by connecting the trend of furnace temperature 
changes with the order appropriate for this notation. Thanks to this approach it is 
possible to enhance information without the additional need to multiply the trans- 
mitted data. It is particularly effective in the multidimensional fuzzy observation 
when monitoring not only the condition of the temperature in the furnace but also 
the ambient temperature and the temperatures in several rooms of the heated build- 
ing. The chapter is a continuation of a series of papers published by the authors on 
multidimensional fuzzy observation using OFN notation. A controller in the conven- 
tional fuzzy logic approach is also presented in the chapter. The controller was built 
using jFuzzyLogic software. The fact that there are more and more OFN applications 
seems to be a good predictor of the development of this generalization, an example 
of which is the problem analyzed in this chapter. 
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16.1 Introduction 


The development of civilization is associated with an increase in energy demand. 
In modern times a variety of technologies is used for generating electricity. Nuclear 
power is one of these technologies supposed to solve the problem of energy shortage. 
Assumptions proved to be wrong, as for the atom and other fuels [59]. People should 
look for alternatives. An important factor in obtaining energy is the amount of car- 
bon dioxide produced, which contributes to climate change. It is assumed that it is 
impossible fully to eliminate fuel combustion resulting in carbon dioxide. Reducing 
emissions of CO% in industrial processes is the optimal solution with regard to the 
interests of individual countries. The main activities that can reduce CO emissions 
include reduction of energy consumption, but significant reduction seems unlikely. 
There is also the possibility of increasing the use of carbon-free renewable energy 
sources such as solar, wind, hydropower, and geothermal resources [59]. Increasing 
the efficiency of energy conversion to useful energy, as the last element affecting 
the reduction of CO? is a proposal the authors intend to develop based on the capa- 
bilities of artificial intelligence, in particular based on fuzzy logic. According to 
the authors the possibility of such process control, which improves combustion effi- 
ciency, whether in domestic or industrial stoves, and will reduce emissions of harmful 
compounds, is remarkable. The combustion process is a chemical reaction of oxi- 
dation that takes place between fuel and oxygen. The result is an exotherm and the 
formation of flue gases. The general process of burning coal is shown in a simplified 
chemical formula below. 


C + 02 —> CO, + released heat (16.1) 


The highest combustion temperature is obtained using the least amount of oxygen 
at which there is no free oxygen in the exhaust gas. In other words, the idea is that 
all the ingredients are oxidized to CO2, H20, SO 2. Oxygen-enriched combustion 
lowers the temperature giving a cooling effect. Combustion with oxygen depletion 
also reduces the temperature, thereby contributing to a partial combustion of the 
fuel. In contrast, a process that is desirable according to the literature [37] is called 
a stoichiometric process. The mixture in this embodiment is burned completely and 
exhaust gases contain neither fuel nor oxygen. Ensuring proper combustion, which 
depends on many factors (e.g., the calorific value of the fuel, the construction and 
function of the stove), may be a difficult control problem. Redefining Eq. 16.1 as the 
basic equation describing the relationship between the combustion components is 
represented by Eq. 16.2. 
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Equally Eq. 16.2 can be represented as an Ostwald graph [63], where this relationship 
for lignite is shown in Fig. 16.1. Using this graph allows regulation of the combustion 
process. When the measuring point is on the line between the axes of the carbon 
dioxide and oxygen, the carbon monoxide content is 0%. If a point is above the 
line it means that an error has occurred. The situation when the point is below 
the line in the combustion means that there is incomplete combustion and in the 
exhaust gas there is carbon monoxide in addition to carbon dioxide. Accordingly, 
Fig. 16.1 shows a coefficient à, which is expressed as ø. The general model of the 
stove on solid fuel for the purpose of this work is shown below Fig. 16.2. The diagram 
shows the essential elements, which are discussed later. Imprecision of factor borders 
accompanying the combustion process has contributed to the use of fuzzy logic. 
This is confirmed by numerous publications, where examples of the work are [30, 
56]; especially important in the context of this article there is the study by [56]. 
Depicting a fuzzy system of monitoring carbon dioxide in the combustion process 
is a Takagi-Sugeno inference model [62]. Combining fuzzy logic with any process 
or phenomenon, in which we use a linguistic description of reality is a broad field of 
research. Lotfi A. Zadeh can be considered the creator of fuzzy logic. In 1965 this 
American professor published an article “Fuzzy Sets” [65] in the journal, Information 
and Control, defining the notion of a fuzzy set, where inaccurate information is 
described by values from the interval (0, 1). 


Fig. 16.1 Ostwald diagram 
for lignite based on [63] 
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Fig. 16.2 Indicative graph 
of a solid fuel stove > la pipe chimney 
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fuel loading 


| E. air inlets 


S1, S2, S3 - sensors, R1 - fan speed regulator 


It can also be said that the precursor of Zadeh’s achievements is the Polish math- 
ematician Jan Lukasiewicz, who in the 1950s published an article on three-valued 
logic [39]. The formulation of the foundations of fuzzy logic and the involvement of 
the scientific community have contributed to the creation of many theories expand- 
ing this subject. One of them is the representation of the L-R fuzzy set. The authors 
Dubois and Prade in [16] introduced the limited membership functions of the two 
functions of the shape of Land R. The linear shape function operations on the numbers 
L-R gave the partial opportunity to reproduce results for the triangular membership 
function. In the case of multiplication, the resulting number of L-R led to enlarging 
the range introducing imprecise intervals. 

We now depart from the genealogy of fuzzy logic development to address again 
the original problem, the process of controlling the stove on solid fuel. The authors’ 
inspiration to write this chapter was that the combustion process can benefit from 
the trend. The trend is visible when the stove water temperature rises to a specified 
level; the upward trend may be shaken by the excess of supplied oxidant. Oxygen 
contained in the exhaust gases and the quantitative composition result in the com- 
bustion process. For example, reaching the required water temperature during firing 
of the stove is associated with the fan modulation to 80-100% of power and leads 
to too lean a mixture. The effect of an excessive amount of oxidant is the cooling 
of the heat transfer medium. The water temperature decreases instead of increasing. 
Temporary and long-term ups and downs translate into the trend of the process [7—9, 
11-15]. Another example might be the work of [6, 21, 38, 41-43, 57, 58], in which 
the authors use the trend as a direction in the problems of management accounting 
and in determining the internal rate of return (IRR) for investment or other issues 
of recognition attack computer networks described in [1—4], and also when talking 
about engineering solutions [7—-14, 44—49, 60, 61, 68]. The opportunity to study 
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the behavior of phenomena expressed as a trend in fuzzy logic is possible thanks 
to directing as proposed by the team of Professor W. Kosiński. The authors’ pro- 
posal [34] concerns the redefinition of fuzzy numbers as directed fuzzy numbers 
OFNs (Ordered Fuzzy Numbers), where the main advantage is the ability to solve a 
linear equation 16.3. 

A+B=C (16.3) 


where A, B are any Ordered Fuzzy Numbers for which the following equality should 
occur. 


A=C-B (16.4) 


In the case of using numbers proposed by Dubois and Prade, Eq. 16.4 will be false. 
This is because of fuzzy number imprecision expansion. Using OFNs enables easy- 
to-perform arithmetic operations on them and on the real numbers. In addition, one 
can use direction as the trend of the process. 


16.2 Selected Definitions 


16.2.1 The Essence of Ordered Fuzzy Numbers 


The basic concept of Ordered Fuzzy Numbers has been described in the introduc- 
tion. In this chapter a deeper concept of OFNs is presented. This is essential for 
understanding the solutions used in the chapter. The authors of OFN are the team of 
Professor W. Kosiński, P. Prokopowicz, and D. Ślęzak (31-36, 51-55]. The prob- 
lem of increasing imprecision with the increasing number of performed operations 
and the lack of solutions to Eqs. 16.3 and 16.4 in fuzzy logic has been noted by the 
authors. Redefining classic fuzzy sets, which is according to Zadeh to postulate an 
ordered pair, expanded the definition of an ordered pair of functions. The number is 
defined there as follows. 


Definition 1 Ordered Fuzzy Number A is an ordered pair of functions 
A= (Xup, Xdown) (16.5) 


where Xup, Xdown : [0, 1] —> R are continuous functions. 


These functions are called, respectively, the up- and down-parts. These two parts 
are connected via a constant function equal to | on the interval. The direction of a 
fuzzy number is called the orientation: the up-part of the OFN is the beginning and 
the down- part is the end of this number. A graphic interpretation of Ordered Fuzzy 
Numbers is presented on the left side of Fig. 16.3, and the right side is the directed 
number with a reference to classical fuzzy numbers. 
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Fig. 16.3 a OFN example, b OFN presented with a reference to classical fuzzy number, and ¢ 
simplified mark denoting the order of inverted functions 
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Fig. 16.4 Schematic diagram of the fuzzy controller 


16.2.2 Fuzzy Controller 


The formulation of fuzzy controller mathematical foundations can be found in the 
literature [28, 29, 40, 64, 66, 67]. These subject-related concepts using linguistic 
variables assume the role of describing input and output states, which we intend to 
express and assess a linguistic description. Linguistic value directly affects the verbal 
assessment of the linguistic object. For example, the linguistic variable ”voltage” 
takes the linguistic values of “small, medium, and high.” The process of fuzzy control 
is shown in Fig. 16.4, which includes operations such as fuzzification, inference, and 
defuzzification. The fuzzification operation is carried out in the first stage. It is 
associated with the calculation of the degree of membership to particular fuzzy sets. 
In the inference stage, based on the input degree of membership we calculate the 
resulting membership function. An important conclusion is that the expected outcome 
is to define the system resulting in the membership function. Both fuzzification and 
inference operations contain a number of specific elements. 

The closing operation of the system is the defuzzification block. It is characterized 
in that the output is a specific (not fuzzy) value. This value is the product of the 
method operating on the resulting membership function and enables the activation 
of the actuator in the desired manner. 
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Defuzzification is therefore a function that assigns a crisp value to a fuzzy number. 
There are several well-described fuzzification functionals, which are utilized in many 
arithmetics used in fuzzy logic, including the following. 


FOM: First of Maxima 


The FOM method is a method of selecting the smallest element of the set A kernel, 
where the fuzzification value is described in Eq. 16.6. 


FOM(A) = min core(A) (16.6) 


LOM: Last of Maxima 


Accordingly selecting the highest value of the set A kernel, we use the LOM method; 
the formula is as below: 
LOM (A) = max core(A) (16.7) 


MOM: Mean of Maxima 


Equation 16.8 shows the use of LOM and FOM as a method for which the fuzzification 
value includes the minimum and maximum elements of the A fuzzy set kernel. This 
value is the average of these two methods. 


MOM(A) = min core(A) t max core(A) (16.8) 


RCOM: Random Choice of Maxima 


The method is also called kernel fuzzification because the fuzzification value is 
always contained in the kernel of a fuzzy set. The fuzzification value of this method 
is a random element x € core(A) calculated as the probability of: 

A(x) 


where A is the Lebesgue measure in universe X. 
MOS: Mean of Support 


This method shows the fuzzification value is the average of the A number medium. 


supp(A) 


MOM(A) = (16.10) 


COG: Center of Gravity 


This is the most common method in cases where it is important to determine the 
center of gravity of the considered system. In the fuzzification process of an A fuzzy 
number, the COG method is expressed as Eq. 16.11. 
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J xua@)dx 


COG(A) = 
J? walx)dx 


(16.11) 


BADD: Basic Defuzzification Distribution 


The method of fuzzification was proposed in [20] as an extension of the COG and 
MOM methods. The fuzzification value of the fuzzy set A is obtained as 


fp xu% (x)dx 


BADD(A) = 
i fi u% (x)dx 


(16.12) 


Itis also worth paying attention to the methods dedicated to OFN arithmetic, which 
are inherently sensitive to directing. These include: Fuzzification method called the 
Golden Ratio (GR): It was established as a result of implementation of an ancient 
division used in Greek architecture. The GR value for the fuzzy number A is given 
by the equation: 


min(supp(A)) + Iuppi „if order (A) is positive 


GR(A) = 
(A) max(supp(A)) — suppl 


16.13 
, if order (A) is negative ( ) 


where GR is the defuzzification operator, supp(A) is support for fuzzy set A in 
universe X, and ® = 1,618033998875.... 

Mandala factor (MF) method: This is the calculation of the R value using the 
Mandala factor W4 sum of function integrals of a rising edge, falling edge, and a 
core set. The resulting value is scaled from the center of the coordinate system by 
adding it to the beginning value of a fuzzy number support set. When fuzzification is 
carried out in OFN arithmetic, in the case of a positive directing procedure described 
as above, and in the case of negative directing a calculated negative value should 
be subtracted from the first coordinate of an OFN number being the OFN number 
support right edge. 


c+r ,if order (A) is positive 


c—r ,if order (A) is negative (ISA 


MF(A) = | 


where 


1 ff e 
-— | xax+ f dx (16.15) 
j=e e d 


Modified center of gravity: This is the result of modifications introduced by Kosiński 
and Bednarek [5] in the classical COG method in order to adapt it to work in OFN 
arithmetic. 
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Fig. 16.5 Graphical representation of selected fuzzification functionals for the same OFN number 
directed a positively and b negatively 
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Figure 16.5a, b are drawings showing different fuzzification results for the same OFN 
directed positively in Fig. 16.5a, and directed negatively in Fig. 16.5b. Calculations 
were performed using selected fuzzification functionals. 


16.2.3 Control of the Stove on Solid Fuel 


Referring to the example of the stove fuzzy controller, a diagram of such a system 
is shown in Fig. 16.6, where S1 is a heater temperature sensor, $2 a temperature or 
exhaust lambda sensor, and $3 an optional gas analyzer. The stove uses an air blower. 
In this example it is called a blower regulator R1. The basic concept of the work of 
the control system is as follows. Input variables that were selected are: 


Water coil temperature: Tw 
Stove flue gas temperature: Ts 
Lambda probe: À 


e 
e 
e 
e Increase of temperature: ATt 
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Output variables are: 
e Speed of the blower 


There are additionally provided auxiliary variables for the solution, Tz, set tem- 
perature, which says what temperature the user prefers, or what temperature is 
optimal for a particular stove. For example, the OFN describing set temperature 
TZ1 = [56, 56, 56, 56] informs the controller to “hold temperature of 56” For the 
number T Z2 = [56, 58, 60, 72] the directing means, “I prefer temperature 72, but 
may be no less than 56.” For the reverse OFN number there is the statement, “I prefer 
56, but nothing will happen if it is 72.” 

Linguistic variables selected for this problem depend on the concept of the con- 
trol operation. For example, the observed coil temperature is lower than the preset 
temperature. The stove driver starts the blower and observes the flue gas tempera- 
ture or A probe. In both cases, the sensors provide information about the progress of 
the operation of the stove. Based on this information, the controller determines the 
amount of air sent by the blower. 


16.3 Classic Fuzzy Controller 


The controller in the classic use of fuzzy logic was done using jFuzzyLogic. The 
technical details are available at http://jfuzzylogic.sourceforge.net. The input lin- 
guistic variables as described in the previous chapter are provided as fuzzy sets. 
Accordingly, we have Figs. 16.7 and 16.8. 


Fig. 16.6 Fuzzy logic 
controller dedicated to solid 
fuel stove 


Fuzzy 
Logic 
Controller 


S1, S2, S3 - sensors, R1 - fan speed regulator 
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Fig. 16.7 Input variable ‘coil temperature’ and its fuzzy set 
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Fig. 16.8 Input variable ‘lambda’ and its fuzzy set 
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Fig. 16.9 Output variable ‘power’ and its fuzzy set 
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The output variable in the example is the power of the blower regulator. Figure 16.9 
shows a membership function of this variable. 

On the basis of expert knowledge concerning the combustion process a set of rules 
used by the controller was created. Different rules express the state of the process as 
a set of conditions and the effects that are recommendations for change. RULE 1: 
IF Tw IS low AND lambda IS rich THEN power IS power_100; RULE 2: IF Tw IS 
low AND lambda IS optimal THEN power IS power_60; RULE 3: IF Tw IS low 
AND lambda IS poor THEN power IS power_20; 


16.4 The Controller for the OFNs 


The controller operation of the directed OFNs requires the use of up and down 
borders, which are formulated as 


Hala) =0, way) =1, wad) =1, malpa) = 0 (16.18) 


A graphical interpretation is shown in Fig. 16.10, in which the Ordered Fuzzy Num- 
bers are marked with characteristic border points. Generally it can be assumed that 
each of the Ordered Fuzzy Numbers can be described by four real numbers: 


A = (la, l3, I}, pa) (16.19) 


In a classic fuzzy controller the resulting membership function is generally a not 
convex fuzzy set. The use of existing t-norm operators in the inference process 
will not help to create an OFN according to border points [65]. In [50] there is a 
proposal which says that instead of t-norm, algebraic operation of multiplication can 
be used. This is illustrated in Fig. 16.11. A sample controller for OFNs, in particular 
the inference block and a way to calculate the degree of activation amounts to the 


Fig. 16.10 Ordered Fuzzy (a) 
Number limit values a 

positively ordered, b 

negatively ordered 


d 
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number A number B result of the operation 


0 1 2 3 + 5 6 7 8 


Fig. 16.11 Multiplication of two OFNs 


number A number B result of the operation 


Fig. 16.12 Addition of two OFNs 


operation presented above. Having calculated degrees of compliance with each of 
the rules, an OFN controller can start to cumulate into a single set which is the result. 
In a classic controller there are s-norm operators. In the controller for OFNs there 
will be the arithmetic operation of addition. For example, for an ordered number A, 
B, which is a product of aggregation, addition is shown in Fig. 16.12. 


16.4.1 Directed OFN as a Combustion Trend 


Linking the trend with the directing is associated with reaching the objective of a 
certain state. In the case when the water temperature of the stove is low, the OFN 
describing this variable should be positive: Fig. 16.10a, which seeks directing to 
the boundary point ua(pa) = 0. Selecting “down” of the OFN emphasizes what 
value the OFN is going to achieve. For example, the stove water temperature can be 
a linguistic variable, as shown in Fig. 16.13. A fuzzy number A indicates that the 
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Fig. 16.13 Fuzzy set of input variable ‘coil temperature’ according to the OFN 


Fig. 16.14 Fuzzy set of input variable 4 according to the OFN 


water is cool but tends to a higher temperature, whereas the number B informs us 
of the optimum state with a downward trend. The number C is specified for high 
temperatures, which should not be achieved. 

The second variable is the information on the air excess in the exhaust, Fig. 16.14, 
which is the A ratio. A number says that the mixture is rich and has a small amount 
of oxidant. In this case the trend as the directing is trying to strive for the B number. 
Number B describes a mixture where the composition is stoichiometric, that is, 
everything is burned, causing high efficiency, and the number C contains information 
about a large amount of oxygen in the exhaust gas and lean fuel mixture. Directing 
of number C tends to the desired state, which is determined by the B number. 


16.5 Modeling Trend in the Inference Process 


The basis for the construction of a fuzzy controller for OFN, according to the assump- 
tion that the number is located within the limits of OFN arms (see Fig. 16.7), is the 
reconstruction of an inference apparatus in such a way that the resulting product that 
is the function was the OFN. The proposal of such a construction is shown in this 
section, where the expert has a method of modeling the direction of the OFN. In the 
first stage we can say that the output fuzzy set is the CFN convex number. As an 
example, it is Fig. 16.15 showing the output variable of a blower regulator power. The 
D number covers the entire range of the blower controller operation. Directing this 
number at this stage is not established, because this is a convex fuzzy number. In con- 
trast, expert judgment is expressed in the set of rules as a degree of compliance with 
the rule, that is, a percentage of the convex CEFN. For example, evaluation of +20% 
is shown in Fig. 16.16. The number of D was reduced by 20% on the figure’s left 
side. In contrast, expert judgment —20% reduces the vehicle from the right side; this 
case is shown in Fig. 16.17. For example, having two linguistic variables Tw and A, 


16 Fuzzy Numbers Applied to a Heat Furnace Control 283 


Table 16.1 Rules for inference process 


Tw Coefficient à 
Rich (%) Optimal (%) 
Low +60 +30 —20 
Average +50 +20 —10 
High +30 +50 —5 
D 


Fig. 16.15 Fuzzy set of output variable ‘power’ according to CFN 


Fig. 16.16 CFN number for 
the expert proposal +20% 


0% 20% 40% 60% 80% 100% 


Fig. 16.17 CFN number for 
the expert proposal —20% 


0% 20% 10% 60% 80% 100% 


taking into account expert judgment expressed as the degree of compliance with the 
percentage share of the output number, a set of rules will form as in Table 16.1. Signs 
in front of the percentages can be interpreted as the imposed direction to CFN from 
Fig. 16.15. In other words, modeling the trend in the inference process is reduced to 
the use of OFNs in the form of CFNs as shown in Fig. 16.15. The result of running 
the rules is imposed orientation: positive when we have a plus, and negative when 
we have a minus. Accordingly, for Fig. 16.15 it will be Fig. 16.18, For Fig. 16.17, 
we have directing presented as in Fig. 16.19. The added value of this solution is the 
ability to regulate the OFN direction at the inference stage. The percentages given 
by an expert can be regarded as a temporary modification. Directing of OFNs will 
be established when we accumulate all the rules. The established resulting OFN will 
allow us to go into the process of defuzzification. Another feature of this solution 
is the ability to reduce the surface area of the OFN. This feature can be particularly 
important from the perspective of defuzzification. Using the method of defuzzifi- 
cation associated with the surface area narrows the result already at the inference 
stage. 
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Fig. 16.18 Example OFN, 
the result of the +20% rule 


Fig. 16.19 Example OFN, 
the result of the —20% rule 


16.6 Conclusions 


Handling of the Ordered Fuzzy Number in engineering applications is an alternative 
to convex fuzzy numbers. Meeting this task entails building an ordered fuzzy con- 
troller, which uses directing. In the context of this chapter ‘ordered’ expresses the 
trend of the studied phenomenon. And trend describes the tendency of a given vari- 
able. With the construction of a classic controller the authors introduced a variable 
associated with the increase in temperature per unit of time. The observed increase 
would allow determination of the short-term changes in water temperature. The use 
of OFN enabled following the trend in every other variable describing the combus- 
tion process. Returning to the main thread of the work, the aim of which was to use 
the trend in the combustion process, the authors focused on the inference process. 
The ability to model the directing of the OFN, which can be seen in the penultimate 
section, expands the possibilities of using the trend. Applying this approach will 
emphasize the trend in the inference process. By manipulating the percentage value 
of the medium of the output OFN, we received a modification of the resulting func- 
tion. The use of this manipulation can be helpful when we want to change directing 
or reduce the OFN medium. Reducing the medium of a number, that is, fuzzification 
process input information, and applying methods such as MCOG, MF, or GR [15] 
sensitive to directing contribute to a better reflection of the process trend. 
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Chapter 17 
Analysis of Temporospatial Gait Parameters 


Piotr Prokopowicz, Emilia Mikolajewska, Dariusz Mikolajewski 
and Piotr Kotlarz 


Abstract Locomotion in post-stroke patients may be severely compromised. Assess- 
ment and treatment of gait disorders after stroke are crucial. Scientists and clinicians 
still look for more effective diagnostic and therapeutic tools. The aim of the study 
was to assess a new fuzzy-based tool for measurement of observed gait parameters 
(velocity, cadence, and stride length, and their normalized values), both in healthy 
people and post-stroke patients. 


17.1 Introduction 


Stroke is the second leading cause of preventable death and the fourth leading cause 
of lost productivity. At least of stroke survivors have limited independence. Thus 
efficient diagnosis, therapy, rehabilitation, and care in patients after stroke constitute 
important scientific, clinical, social, and economic challenges. 

Assessment and treatment of gait disorders after stroke constitute a major compo- 
nent of post-stroke rehabilitation. Locomotion in post-stroke patients may be severely 
compromised. Disturbed (as a result of a stroke) motor control influences gait move- 
ments and the expected rate of recovery of walking function. Gait impairments can be, 
for example, a significant factor in falls and mobility limitations. The main element 
of the gait-related rehabilitation program of stroke survivors is task-related training 
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with the strong dose of practice [22]. Diverse technologically complex interventions 
(from repetitive task-specific practice to complex games involving robotic systems, 
virtual reality, and augmented reality) may be applied to improve gait post-stroke. 
Availability, mode of application, and costs of the particular methods may vary, but 
the key issue focuses on their efficiency. Pure compensatory effects avoiding is also 
important. 

Despite efforts of scientists and clinicians, the validity of many interventions 
within rehabilitation of gait post-stroke appears to be limited. Outcomes of gait 
recovery due to rehabilitation depend on many factors, including location and size of 
the lesion, kind and severity of impairment, available activity, cortical activation, and 
associated rehabilitation-induced activity-dependent neuroplasticity. To establish an 
adequate, flexible, and efficient rehabilitation program, the key element is a selection 
of the appropriate measurement tool according to the individual’s level of function. 
Such a tool, used in everyday clinical conditions, should be simple, quick, cheap, 
exact, sensitive, valid, and relevant. What is more, possible impairments in gait coor- 
dination may be a cause of falls and diverse mobility limitations, thus therapy should 
be introduced as early as possible [7]. There should be a possibility to use the clinical 
tool for gait assessment at every stage, even early post-stroke, to assess both quanti- 
tative and qualitative parameters and compare results to the norm or other patients. 
Such an approach may help to restore the patient’s best possible functioning [13, 
14]. Improved assessment tools allow more detailed, valid, and reliable gait assess- 
ment independently of the phase of the rehabilitation program, and construction of 
efficient gait rehabilitation models in post-stroke patients. Current evidence does not 
demonstrate such a tool which is clinically, statistically, and economically important 
[5]. Gait velocity, although important, does not reflect changes in gait quality. 

Gait quality is important for harmonic long-term efficiency of gait recovery. Even 
slower, but high-quality gait patterns at an early stage of rehabilitation may provide 
better long-term rehabilitation results reflected in various gait parameters. 

The aim of the study was to assess a new fuzzy-based tool for measurement- 
observed gait parameters (velocity, cadence, and stride length and their normalized 
values), both in healthy people and post-stroke patients. The hypothesis is that this 
fuzzy-based tool for measurement-observed gait parameters is effective in the assess- 
ment of gait re-education in patients after ischemic stroke. 


17.2 Methods 


17.2.1 Subjects 


The investigated group consisted of 50 patients: 25 healthy ones and 25 after ischemic 
stroke. Ischemic stroke is the most common stroke type; it constitutes approxi- 
mately 80-85cases [3, 4]. A study group was established on the basis of the cri- 
teria described. Inclusion criteria for patients were as follows: age above 18 years, 
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Table 17.1 Patients’ overall profiles 


Healthy people (n = 25) Post-stroke patients (n = 25) 
Sex: 
Females (K) 12 (48%) 12 (48%) 
Males (M) 13 (52%) 13 (52%) 
Age [years]: 
Min 51 49 
Max 72 82 
Mean 58.6 65.28 
SD 6.29 9.56 
Median 56 68 
Side of paresis: 
left (L) n.a. 13 (52%) 
right (R) n.a. 12 (48%) 
Time after cerebrovascular accident (CVA): 
Min n.a. 1 
Max n.a. 4 
Mean n.a. 2.56 
SD n.a. 1.17 
Median n.a. 3 


time after cerebrovascular accident (CVA) from 6weeks to 3 years, and diagnosis 
of ischemic stroke. The inclusion of patients was confirmed each time by medical 
records. Inclusion criteria for healthy people were: age above 18 years and lack of 
CVA and other diseases influencing gait function in the medical record. The patients’ 
profiles are presented in Table 17.1. 


17.2.2 Methods 


Healthy people were assessed once. Post-stroke patients participated in the reha- 
bilitation program. Patients were treated by the same experienced physiotherapist 
(>15 years of experience in neurorehabilitation). Ten sessions of the therapy were 
provided in 2 weeks (10 days of the therapy). We used our own method of gait analy- 
sis, described in [12-14]. It is based on gait recording using a video camera with 
visual gait evaluation, measurement of temporospatial gait parameters (gait velocity, 
cadence, stride length) and their assessment, and calculating normalized values using 
the Clinical Gait Analyzer (free software developed by Ch. Kirtley). Measurements 
were performed in every post-stroke patient twice: on admission (before the therapy) 
and after the last session of the therapy to assess rehabilitation effects. 
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17.2.3 Statistical Analysis 


Wherever possible, the results are given as mean, SD, median, minimal value, and 
maximal value. The Shapiro—Wilk test of normality was applied. The calculation of 
correlations (Spearman’s rho) was made based on changes of parameters: gait veloc- 
ity, cadence, and stride length, their normalized values, and results of the fuzzy-based 
assessment. The data were analyzed with the Statistica 9 software. The results were 
statistically analyzed using the Wilcoxon’s test. The level of statistical significance 
(p value) was set at 0.05. 


17.2.4 Fuzzy-Based Tool for Gait Assessment 


The subject of the research-the quality of gait-is a difficult term for formal precise 
definition. It depends on the general public and varies depending on the group we 
consider to be the norm in terms of gait. If the precise model is out of reach, we 
can use the tools for imprecise information processing: fuzzy systems. Their main 
advantage is the flexibility, intuitiveness, and clarity of rules that are easy to describe 
linguistically. 

The concrete proposition here is the multicriteria fuzzy evaluator of gait (MuFEG) 
defined for the purposes of the study presented in this chapter. This tool evolved 
from the multicriteria fuzzy evaluator proposed in [21], the purpose of which was 
evaluation of multicast routing algorithms. The measure of proper gait is presented 
as a percentage, where is an ideal quality. Defining MuFEG’s basic model for a 
good quality of gait, assumptions have been made that the quality of gait in people 
with no stroke, that is, a reference group of respondents, cannot be lower than. The 
presented results were achieved by combining three different descriptors of a gait. In 
the version of MuFEG used in the present studies, these descriptors are represented 
by three fuzzy Mamdani-type systems. A general idea of such fuzzy systems and 
precise presentation can be found in many books, for example, [1, 15, 16]. Finally, 
their results are aggregated to one normalized outcome. Two concurrent MuFEG 
approaches are used. Their working names are 1b-25 and KFNc-25. Both are based 
on the same assumptions and the same rules. The first, 1b-25, is the classical fuzzy 
system with: 


e Singleton fuzzification. 

e Implication operator, MIN. 

e Defuzzification is realized as implications and the middle of maxima (MOM) 
method defuzzification. 


The fuzzy set representing the ideal value for each gait parameter is constructed 
from the data given for the reference group, people without stroke. Each of them is a 
triangular fuzzy set (see L-R fuzzy sets notation in [6]) and is determined on all the 
available data. For example, let’s look at set good gait velocity (good-GV): 


17 Analysis of Temporospatial Gait Parameters 293 
good = GV = A(x; Xmean — 2 7 AL, Xmeans Xmean + 2 s AR) (17.1) 


where Ay = Xmean — Xmins AR = Xmax — Xmean> 
Xmin/Xmax/Xmean, the minimum/maximum/mean value of the gait velocity parameters 
for the available data about healthy (non-post-stroke) people. 

As there are three systems with one input each there is no need for the aggregation 
of premise parts of the rules. The second fuzzy system, KFNc-25, is based on the new 
model of processing imprecise data, the Ordered Fuzzy Numbers (OFN; see Chap. 4). 
In the papers [18, 19] the name “Kosinski’s Fuzzy Numbers” (KFNs) model is also 
used alternatively. For the calculations of MuFEG results the tool implemented by 
the first author (P. Prokopowicz) was used. Its basic functionality is the modeling of 
fuzzy systems with the OFN model as well as with classical fuzzy sets. The variant of 
MUuFEG for classical fuzzy sets was also implemented using the fuzzy logic toolbox 
for MATLAB for the reference purposes. The results were the same, thus it proved 
the author tool in this scope is correct. As OFN is a relatively new conception, the 
tool in this aspect is completely a pioneer. 


17.2.5 Main Ideas of the OFN Model 


The OFN mathematical model [10, 11] takes into account the order of the charac- 
teristic parts of a membership function of a fuzzy number. As a result, it extends the 
general idea of fuzzy numbers with an additional feature, a direction. As the result 
of using the direction in calculations, we have the opportunity to reduce the impre- 
cision of the following operations. The OFN computational model has a number of 
properties. Some of them were presented in [17]. Apart from good calculations, the 
direction also gives additional potential in the interpretation of fuzzy data. It can be 
treated as a direction of the process, for example, “Velocity is high and is growing,” 
is a different situation from, “Velocity is high, but is decreasing.” The direction of the 
OFN can be used to represent the difference between these sentences. Because we 
deal with additional information, there is a need for the new methods which benefit 
the full potential of OFNs in modeling of linguistic data. The papers [10, 17-20] 
describe the research of the OFN processing methods that consider the direction. 

Thanks to the new property, a new potential for the practical use of OFNs also 
appears with a new quality associated with the direction. The work [8] presents the 
practical use of this property in modeling financial data, and [9] diversity of opinions 
in social networks. In [2] the application of OFNs for an ant colony optimization 
algorithm is presented. Here we use the new model for defining an assessment tool 
for gait. 
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17.2.6 OFN Model in Gait Assessment 


At the present stage of the research presented in this chapter, considering the direction 
is not a key element. However, for the future extent of this research OFN gives 
additional potential. It presents the possibility of trend processing (see Chap. 4). Ina 
gait assessment, measuring the trend of changes can be more valuable than the only 
present quality. Itis especially appropriate when we want to evaluate the effectiveness 
of different therapeutic approaches. The MuFEG system in the OFN variant used here 
is designed as generally preferring higher values of inputs. For example, for the stride 
length, the value near the lower limit of healthy people’s interval gives a worse result 
than the value near the upper limit. 


17.3 Results 


The results are presented in Tables 17.2, 17.3, and 17.4. 

Changes in the six main temporospatial parameters were reflected in the changes 
of MuFEG-generated percentages both in healthy people and post-stroke patients. 
The main statistically relevant correlations observed in the study were similar in both 
groups. 


17.4 Discussion 


Post-stroke patients often suffer from multiple limitations of the ability to perform 
everyday activities. Thus they need rehabilitation in more than one area. But an 
assumption may be true that it is hard to achieve simultaneous recovery in all areas 
(including gait function, hand function, activities of daily life) in a relatively short 
period of rehabilitation (10 sessions) [13, 14]. In the described research we focused 
on gait rehabilitation. The study has focused on determination of changes in gait 
parameters (gait velocity, cadence, and stride length) observed as a result of the 
therapy in a group of patients after ischemic stroke. No doubt, there were observed 
statistically relevant changes in gait parameters as the result of the therapy. A good 
quality of the gait depends on many different factors. We must remember that we 
compare the gait of people after stroke with a reference gait of people without stroke. 
However, in the context of the evaluation, these model people are considered as 
healthy; in fact, their gait may be affected by many different factors, ranging from 
diseases other than stroke, through bad habits of posture or finally physical fatigue 
on examination day. Thus it is obvious that the good quality of gait evaluation is not 
a crisp value. 

The proposed solution is an element of the broader concept, using fuzzy numbers, 
fractal dimension, and artificial neural networks to analyze the human gait in a more 
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Table 17.2 Results of the study-traditional approach 
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Healthy people | Post-stroke patients (n = 25) 
(n = 25) 
Before the therapy | After the therapy | Change 

Gait velocity [m/s] 
Min 1.6 0.1 0.1 —0.5 
Max 2.2 0.8 1.6 0.8 
Mean 1.81 0.48 0.57 0.06 
SD 0.17 0.11 0.16 0.02 
Median 1.8 0.5 0.5 0.05 
Normalized gait velocity [-] 
Min 0.52 0.05 0.04 —0.07 
Max 0.72 0.28 0.53 0.25 
Mean 0.61 0.16 0.19 0.07 
SD 0.06 0.05 0.04 0.02 
Median 0.58 0.16 0.17 0.02 
Cadence [steps/min] 
Min 102 36 24 —34 
Max 142 100 151 67 
Mean 123.72 78.24 82.56 4.4 
SD 11.54 16.92 21.29 17 
Median 126 81 88 4 
Normalized cadence [-] 
Min 0.54 0.17 0.12 —0.18 
Max 0.73 0.51 0.76 0.34 
Mean 0.62 0.39 0.41 0.12 
SD 0.05 0.09 0.12 0.02 
Median 0.61 0.41 0.43 0.13 
Stride length [m] 
Min 1.54 0.57 0.61 —0.55 
Max 2 2.22 2.5 0.5 
Mean 1.76 1.44 1.61 0.21 
SD 0.18 0.46 0.53 0.05 
Median 1.67 1.54 1.54 0.14 
Normalized stride length [-] 
Min 1.7 0.38 0.72 —0.6 
Max 2.23 2.5 2.94 1.19 
Mean 1.93 1.62 1.86 0.24 
SD 0.21 0.36 0.6 0.06 
Median 1.84 1.73 1.85 0.18 


(continued) 
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Table 17.2 (continued) 


Healthy people | Post-stroke patients (n = 25) 
(n = 25) 
Before the therapy | After the therapy | Change 

MuFEG assessment [%] (1b-25) 
Min 64.17 0 0 —26.67 
Max 92.34 33. 83 57 53.67 
Mean 82.46 12.49 20.19 6.33 
SD 0.08 0.14 0.17 0.19 
Median 83.5 5 26 1.17 
MuFEG assessment [%] (KFNc-25) 
Min 59.93 0 0 —21.39 
Max 95.93 36.71 54.31 41.41 
Mean 78.25 14.44 20.95 6.51 
SD 0.09 0.13 0.16 0.16 
Median 79.79 11.45 19.53 0 


comprehensive way, without any wearable devices. Finally, the described system 
could be used both for gait analysis of runners and for developmental issues of 
children. Three possible results of the therapy (recovery, no change, and relapse) 
may confuse analysts. But the main result of short-term therapy may be varied. 
Sometimes gait re-education aims at increasing gait quality, and the changes in 
gait velocity or cadence will be observed during the next rehabilitation periods. 
Fuzzy-based software should provide full support for the data analysis in such cases. 

The most important advantage of the MuFEg is that it does not require any addi- 
tional procedure: temporospatial gait analysis is a part of normal clinical practice in 
neurorehabilitation. Moreover, the result of our analysis reflected in one number has 
enough informative and predictive power and allows the assessment of the general 
tendency. Thus the EBM-based clinical decision-making process may be quicker and 
easier. Of course, if necessary, detailed temporospatial gait parameters also may be 
used. The main limitation of the research is a small sample, but we regard this study 
as a preliminary one. The discrepancy between results shown in Tables 17.3 and 
17.4 proves the necessity of further calibration of the MuFEG algorithms, including 
various samples of healthy people and patients, even on much bigger retrospective 
datasets. 

The next step will also be establishing an online version of our gait analyzer, to 
gather opinions of other MuFEG users and medical data analysts. Bigger samples 
should provide further comparative studies on validity and reliability of the pro- 
posed fuzzy-based measurements. Results of the pure study show that physiotherapy 
interventions significantly influence gait function and coordination. However, even 
the most promising approaches aiming at restoring gait coordination require reliable 
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clinical diagnostic tools. Such tools allow for more objective diagnosis and reassess- 
ment (performed at every stage of the rehabilitation to check progress in the therapy), 
and may help to achieve a better understanding of the nature of both neuroplasticity 
and coordination deficits in functional tasks after stroke and their optimal role in the 
neurorehabilitation. 

Future research also requires work with the MuFEG system. In particular, the 
OFN variant provides an interesting potential of flexibility. Considering trends in 
the information will allow for searching the solutions that estimate therapy methods 
in the various contexts. For example, we can prefer the improvement of the quality 
of gait which is small but regular over a large but occasional one. For the future, 
it is also worthwhile considering distinguishing the differences in bad estimations, 
particularly in the cases when results are too low and too high. Moreover, based on 
the good arithmetical properties of the OFN model it is possible to provide fluent 
use of such imprecise data in further processing without additional transformations. 


17.5 Conclusions 


In the previous sections tools for measurement of the quality of gait were presented. 
They are based on the fuzzy system conception that allows for creation of the formal 
model from linguistic opinions. It is, in general, the main advance of the fuzzy system 
approach. The model formulation is intuitive and easy to understand not only for a 
computer science researcher but also for medical personnel. Analysis of the results 
presented in Tables 17.3 and 17.4 confirm that the proposed new fuzzy-based tool for 
measurement-observed gait parameters (MuFEG) may be efficient both in healthy 
people and post-stroke patients. 

One of the tools was based on the specific OFN model. The research presented 
here shows that is possible to use that kind of fuzzy system in similar situations as 
the classical fuzzy systems. In addition, the use of an OFN model-based tool seems 
more appropriate as it has more flexibility for future expansion of the research. It 
seems to be a good direction to search for a tool to obtain a measure of tendency in 
the changes of results after long-term rehabilitations. 
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Chapter 18 
OFN-Based Brain Function Modeling 


Piotr Prokopowicz and Dariusz Mikołajewski 


Abstract A modeling approach may significantly help to explore the problem of 
weak understanding of the physiological and pathological central nervous system 
function in the most noninvasive and comprehensive way. The aim of this chapter is 
to assess and discuss the extent to which possible opportunities concerning compu- 
tational brain models based on fuzzy logic techniques may be exploited. 


18.1 Introduction 


Structured networks and functional connections of interacting neural populations 
underlying both physiological and pathological central nervous system (CNS) func- 
tion are still poorly understood. Interdisciplinarity and independence of research 
provide a variety of scientific approaches, used tools, and wide coverage and even 
overlapping of the research fields, especially as regards human research, including 
neuroscience [1]. The modeling approach may significantly help to explore the afore- 
mentioned problem in the most noninvasive way. The aim of this chapter is to assess 
and discuss the extent to which possible opportunities concerning computational 
brain models based on fuzzy logic techniques may be exploited. 
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18.2 State of the Art 


18.2.1 Theory 


Researchers within the basic sciences follow their intuition, knowledge, and creative 
thinking, finally formulating principles of nature [1]. It is easier to derive general 
mechanisms because they are often repetitively used in many versions. Thus gath- 
ered information may be more complete. An additional problem within knowledge 
gathering is ensuring the highest possible quality of research. An important way 
to assess relevance of research seems to be critical peer reviews, including novel 
approaches including the role of preprint servers (such as ArXiv) and open reviews. 
Due to emerging interdisciplinary approaches, a variety of used methods and tools, 
and overlapping methodologies, it is hard to ensure the quality control of scien- 
tific papers. Weaknesses of traditional preprint reviews (such as inability to detect 
errors/fraud, lack of transparency and reliability, potential for bias and unethical 
practices, inconsistencies among reviewers) may be eliminated by quicker postprint 
reviews, supporting the relevance of evidence and building knowledge. This may con- 
stitute a novel gold standard in the assessment of scientific papers [12, 22, 24, 30, 60]. 
The functional organization of the central nervous system (CNS) in humans is not 
fixed. No doubt functional representations are dynamic and continuously modified 
by the human’s experience due to experience-dependent plasticity as far as neuro- 
logical diseases or injuries and natural age-dependent neurode-generative changes 
are concerned. 


18.2.2 Modeling Complex Ideas with Fuzzy Systems 


Fuzzy set theory [66, 67] offers powerful potential in modeling imprecision under- 
stood differently from possibility. There are many publications that gather basic ideas 
[38, 39, 56]. As mentioned in previous sections, researchers who work on the prob- 
lem of brain modeling often try to connect practical observation results with intuitive 
knowledge. Some parts of this knowledge are precisely formulated but other parts 
are vague. This gives us an opportunity to use an experience of the brain modeling 
scientists and merge it with the concrete results of available research. The theory 
of fuzzy sets offers help for defining formal models in situations where only lin- 
guistic description is possible [67]. The idea of hierarchical fuzzy systems [19, 20, 
48] offers special modeling potential which is a good tool for representing complex 
dependencies. It preserves the intuitive linguistic description of a model and also 
allows description of highly complicated relationships. When the modeled object 
needs quantitative parameter representation, use of the classical theory of fuzzy sets 
can pose some calculation problems. The specific model of Ordered Fuzzy Numbers 
(OFNs) overcomes typical computation problems with classic fuzzy numbers (see 
[27, 28, 42] and also Sect.4.2 of Chap.4). An additional advantage of OFNs is the 
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potential for modeling a trend, which provides a process with more information than 
only value. As it is intuitive information provided by the experienced brain modeling 
scientists it makes it easier to represent the dependences as growing and decreasing. 
In the following parts of this text the idea of a fuzzy inference block is presented 
(see also [45]). It is a basic conception for modeling complex dependencies using 
the general fuzzy concept. The OFN have special application potential there. 

As another interesting application of OFNs, in Sect. 18.6.3 of this chapter the 
proposition for modeling the learning rate coefficient (an important element of the 
neural network adaptation procedure) is presented and discussed. 


18.2.3 Clinical Practice 


Knowledge exploitation is not easy, the evidence-based medicine (EBM) para- 
digm. The so-called EBM triad combines three main factors influencing the clinical 
decision-making process: 


e Individual clinical knowledge and experience 

e Actual, reliable, valid, and statistically significant in the particular case of external 
evidence 

e Values and expectations of an individual patient (and sometimes his or her 
family) [33] 


Incorporation of EBM provides conscientious, explicit, judicious, and reasonable 
use of novel reliable evidence in clinical decision making about the care of individ- 
ual patients [33]. An ideal research method for clinical purposes should be direct, 
noninvasive, and sufficient spatial and temporal resolution of the purposeful represen- 
tation imaging in an awake patient. The common strategy aims at a more complete 
brain atlas incorporating and integrating anatomy in macroscale, microscale, and 
nanoscale, and data from medical imaging, including functional ones (fMRI, MRI, 
DTI, MEG, etc.). 

The aforementioned solution would be useful for better understanding of brain 
structure and function, both from a physiological and pathological point of view 
[58]. The ultimate aim is the identification of disease-related alterations affecting 
neural structures and their functional connectivity [23]. Moreover, interdisciplinary 
studies may fill the gaps between all of the involved disciplines that are still unex- 
plored. It requires bigger teams consisting of neuroscience theorists, physicians, 
neuroanatomists, and specialists in image analysis, data analysis, computational neu- 
roscience, molecular biology, physiology, cognitive science, and even philosophy. 
Invalid or incomplete integration of neural information within the human brain is 
perceived as the main cause of mild and severe neurological disorders, affecting not 
only cognitive processing, but also emotional processing and motor control. Invalid 
synchronized or simply unsynchronized structures may be deployed far from each 
other, and their weaker than usual co-occurrence of excitation/inhibition may be hard 
to detect. Thus structural connectivity (SC) is only one part of functional connectivity 
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(FC). Their exact and complete description is far beyond our current possibilities, but 
despite that, such results for particular diseases have been reported [23]. Analysis of 
the interaction between social and biological determinants of behavior emphasizes 
better understanding of the complexity of the human brain in action thanks to: 


e Coequal contributions of emotions and affects towards normal brain functioning 
regarding the “higher” and “lower” cognitive functions built into human neuro- 
physiology 

e Brain relation to body in biological psychiatry thanks to embodiment, embedded- 
ness, enactivism, extended cognition, and situatedness 

e Importance of “being in relation” for reasonable neural functioning, especially in 
terms of social relationships for the human brain from birth until death 

e Computational neurosciences taking into account information integration theory 
[37] 


Large prospective datasets of patients with Alzheimer’s disease (AD) allow us to 
construct advanced brain models of (physiologically) healthy subjects and patients 
with AD (with pathophysiological changes occurring over time). Despite the huge 
amount of information taken into account and efforts of scientists, the aforementioned 
models are still regarded as inadequate. Their limitations are: lack of scaling (i.e., 
they are single-scale) and lack of reflecting the complexity and interdependence of 
brain changes at different levels (molecular, cellular, tissue) [49]. We should take 
into consideration that changes in a patient’s brain may take place much earlier 
than visible symptoms and diagnostic outcomes. Thus early diagnosis providing 
datasets for early changes within the central nervous system may be difficult to obtain. 
MR elastography (MRE) varies for a healthy brain, but is regarded as a reliable 
marker of neurodegenerative disease (e.g., dementia) [35]. Rapid development of 
artificial stimulation techniques (e.g., transcranial direct current stimulation, tDCS) 
both in clinical practice and cognitive neuroscience research requires development 
of a completely novel family of computational models of such phenomena [47]. 


18.2.4 Models for Linking Hypotheses and Experimental 
Studies 


The simplest relationships among theory, computational models, and experimental 
research are: 


e Predictive understanding of brain processes needs for experimental data placed 
into a quantitative framework. 

e Aforementioned framework is provided by biologically plausible computational 
models. 

e Computational models provide a tool for exploring cognitive and brain processes 
too complex for direct exploration (e.g., due to diverse timescale or simultaneous 
multilevel processing). 
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e Aforementioned environment allows us to interpret results from empirical studies 
and generate novel hypotheses, testable using further models and experimental 
studies. 

e Computational models may inspire novel theories that are difficult to formulate 
based only on analysis of the experimental results [47]. 


Detailed strengths and limitations of computational brain models have been analyzed 
in [45]. The most advanced projects within neuroscience such as the EC Human 
Brain Project are hard to plan and develop; there is a lack of simple principles within 
understanding the brain (neural codes, transformation laws) and no particular sci- 
entific method has proven to be the right one. Even selecting any single direction 
regarded as the most probable is not always possible; despite the best current knowl- 
edge, previous achievements, and further efforts there is very limited chance to hit 
the target. Thus application of traditional scientific paradigms that proved to be suc- 
cessful during the last several centuries may be insufficient [1]. There is a need for a 
novel approach, derived from accumulated knowledge and experience of many sci- 
entists, creatively engaging interdisciplinary approaches and tools. Henry Markram 
has defined seven challenges for neuroscience [32]: 


e Big research teams with the resources sufficient to deal with the big scientific 
problems 

e Data ladders, interlinked sets of data providing a complete image of single areas 
of the brain at their different levels of organization 

e Efficient predictive tools 

e Novel hardware and software sufficiently powerful to simulate the brain 

e New ways of classifying and simulating brain diseases, leading to better diagnosis 
and more effective drug discovery 

e New brain-inspired technologies, with benefits for industry and for society 

e Social understanding of neuroscience and its benefits for society [32] 


Although the assumption that realistic computational models are easier and quicker 
solutions than reconstruction of the whole brain region or even the whole central 
nervous system [14] may be true. To build a model of the whole brain we have to 
take into consideration 1,000 different gray matter regions, 5,000 neuron classes, 
and up to 100,000 macroconnections between the aforementioned neuron classes, 
which are not always fully identified [4]. The volume of the human cerebral cortex 
similar to a pinhead (1 cubic millimeter) can even contain up to 27,000 neurons and 
1,000,000,000 synapses. Moreover, the data derived from research on nonhuman 
brains cannot fully substitute information on humans. Although some brain organi- 
zation aspects are common to all mammalian species, certain fundamental structural 
and behavioral aspects are unique to humans, including evolutionary adaptations and 
neurotransmitter modulatory effects involved in many neuropathologies (Parkinson’s 
disease, Alzheimer’s disease, depression, etc.) [13]. Computational models may 
be regarded as simplified abstractions but they link more complete data concern- 
ing anatomical structure with incomplete information concerning somata and the 
processes within cellular components gathered thanks to light microscopy and elec- 
tron microscopy [10]. 
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18.3 Concepts 


Requirements for relevant computational models of CNS are: 


e Reproducibility: Available built-in, run and assess outcomes of simulation features 
(structures, signals, features) within processes reported earlier in a scientific paper 

e Transparency: Highly visible internal properties 

e Accessibility: Available to other scientists in an understandable format 


Some researchers also require portability (i.e., cross-simulator validation and 
exchange of models thanks to formats open to interconnection), but it may be hard 
to achieve. 


18.3.1 Data Ladder 


Reconstruction of the connectivity map of the brain (connectomics, i.e., tracing the 
aforementioned map accompanied by better understanding of related interactions) 
need diverse approaches and scales [54]. A data ladder shows coincidence and cor- 
relation among processes and mechanisms taking place at subsequent levels of the 
human body (from the bottom): genes — , proteins >, neurons — , neuronal dynam- 
ics —, and whole brain process — behavior [32]. Genetic factors may influence 
prognosis in many diseases and injuries, including pathophysiology of traumatic 
brain injuries. The aforementioned assumption may potentially lead to new treat- 
ments and improved outcomes of therapy and rehabilitation [16]. A more detailed 
view of CNS covers nine levels (from the bottom): 


Jon channels 
Signaling pathways 
Synapses 

Dendritic subunits 
Neurons 
Microcircuits 
Neural networks 
Subsystems 
Nervous system 


18.3.2 Models of a Single Neuron 


There are many shapes and sizes of neurons. Thus modeling of a single neuron 
constitutes a true challenge and requires an individual approach. The key question 
is: how does a particular neuron transform synaptic inputs into potential action output. 
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Although a single neuron can be divided into distinct morphological and functional 
regions: 


e Receptor apparatus: Formed by the dendrites and cell body or soma 
e Emission apparatus: Axon 
e Distribution apparatus: Terminal axonal arborization 


there are many exceptions: bidirectional connections, electrical synapses, various 
axosomatic and axodendritic synapses, and the role of neuron-glial interaction within 
information processing [14]. Realistic modeling of brain functions is based on a 
more detailed biophysical description of neurons and synapses (at the molecular and 
cellular levels) integrated into microcircuits, and then further integrated in large- 
scale brain networks and even brain systems [11]. Seven models of a single neuron 
may be multilayer: from the electric field distribution, through modeling of the sin- 
gle compartment effects, to the multicompartment neuron model [47]. Accurate 3D 
reconstructions of neurons are typically created using: 


e Neurolucida after biocytin histology 
e Neuromantic to reconstruct from fluorescence imaging (FI) stacks acquired using 
2-photon laser-scanning microscopy during physiological recording [3] 


18.3.3 Models of Biologically Relevant Neural Networks 


According to the concept by DeFelipe [14] there is a need to identify the general 
connection matrix of the brain based on three main levels of operation and modeling: 


e Macroscopic: Providing a map of major tract connectivity (connectome), acquired 
using medical imaging (e.g., fMRI) 

e Intermediate: Providing a map of connections, acquired using light microscopy 

e Ultrastructural: Providing a map of the synaptic connections (synaptome), acquired 
using electon microscopy [14]. 


Imprecise connectomes and incomplete synaptomes require an integrative approach 
to fill the gaps. Statistical models allow us to determine the range of variability of the 
particular parameters by sampling relatively small regions of the brain, especially 
within the cortex. There is a need for careful limitation of such an approach to avoid 
imprecision of estimation (e.g., ranges and types of synapses). The main initiatives 
concerning modeling of biologically relevant neural networks are: 


Human Brain Project (HBP) based in the European Union 

Brain Activity Map based in the United States [25, 32, 68] 
Allen Institute for Brain Research [Allen Institute] 
NeuroMorpho.Org [2] 

BAMS2 Workspace [5] 

The Canadian Brain Imaging Research Platform (CBRAIN) [52] 
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Analysis and interpretation of the functional brain networks during different cog- 
nitive activities require advanced approaches to the spatiotemporal and spectrotem- 
poral brain data such as Functional Pattern Graph, NeuCube, and Intrinsic Signal 
Optical Imaging [26, 36, 57]. Simplified computational models of convective drug 
distribution in the primate brainstem were consistent with the outcomes of in vivo 
experiments [55]. 


18.3.4 Models of Human Behavior 


The key issue constitutes models of learning within CNS. The learning process 
is often identified with modification of interneuron connection strength. Different 
learning rules may be applied. Moreover, synapses may change the strength of their 
response to neural activity in two basic ways: 


e Short-term changes, lasting from milliseconds to seconds, which are important, 
but regarding them as learning is still discussed. 

e Long-term potentiation (LTP) and long-term depression (LTD), lasting from hours 
to years. We also should take into consideration a noise effect, overlapping of neural 
fields, and choice of information relevant in the current task (e.g., decision making). 
Another problem constitutes neural plasticity, for example, spike-time-dependent 
plasticity (STDP). 


18.4 Traditional versus Fuzzy Approach 


There are three basic areas of OFN application within computational brain modeling: 


Reflecting physiological brain procedures normally performed by fuzzy-like 
neural networks, such as natural language processing, but one should take into 
consideration that the assumption of the right hemisphere being better at process- 
ing fuzzy signals than precise information may be true 

Simplification of complex computational procedures, hard to familiarize in another 
way, for example, kWTA-like mechanisms 

Reflection of various pathological processes, for example, fuzziness (absence of 
precision) of information in some diseases 


18.5 OFN as an Alternative Approach to Fuzziness 


The OFN model is introduced in detail in Chaps. 3 and 4. Generally, it is a tool for 
processing imprecise quantitative values represented by fuzzy numbers. OFNs have 
an additional feature used in processing: direction/orientation. It allows us to define 
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arithmetical operations in a new way. The proposed methods maintain the basic 
computational properties of the operations known for real numbers. Apart from a 
good calculation capacity, ORNs also offer new possibilities for processing imprecise 
information. The new property, an order, has a major impact on the calculations, but 
also provides a new potential for processing data in fuzzy systems. We can include 
into the fuzzy value additional interpretations apart from the membership value. The 
new feature of processing is called ‘sensitivity for the direction’ (see [43, 44, 46] 
and Chap. 5) and makes it possible to involve in a model such expressions as, “The 
temperature is about 20°C and it is increasing’. 

In the case of the OFN model and processing methods that can be called ‘arith- 
metic’ (see [40, 41, 43, 44]), at each stage of the fuzzy system process we deal with 
the quantitative aspect of the data. Thus we consistently obtain fuzzy numbers at each 
step: the aggregation of premises, the inference and the accumulation-aggregation 
of the rules answers. Such property of a fuzzy system is even more important when 
modeling the complex relationships of the brain functions. It can be used as a para- 
meter for other calculations without the direct output of individual rules. It can be 
hard to achieve this in a traditional fuzzy approach when during processing in the 
fuzzy system the quantitative character of processed data is generally lost. 


18.6 Patterns and Examples 


18.6.1 Intuitive Modeling of the Complex Functions 


This concept was already presented in [45], and its key elements are provided here. 
A significant part of our knowledge about the functions of the brain is vague and 
imprecise. Thus, fuzzy logic seems to be a good solution when we look for tools used 
in modeling such an object. Although fuzzy techniques are used in object recogni- 
tion and linguistic property modeling [29], there is only poor evidence concerning 
their use in brain simulations. There is a need for a novel, more effective approach, 
providing a better, clear, and easy understanding of the processes underlying brain 
function. 

It is difficult to describe a simplified brain function in the form of mathematical 
equations. As mentioned before, brain function arises from complex behavior of 
units on the lower level (neurons, synapses, etc.). It makes this situation similar 
rather to multiagent architecture. However, a cascade and hierarchical fuzzy logic 
systems [19, 20, 48] may provide another insight into the behavior of the particular 
subsystems or mechanisms, allowing easy configuration and use of complicated sets 
of semirealistic features. Processing of information using a fuzzy system usually 
begins with a fuzzification operation and ends with defuzzification. Fuzzification, in 
general, is the conversion of a crisp value into a fuzzy one and defuzzification is a 
reverse operation. This operation can be done in many different ways. A choice of a 
proper method (especially the defuzzification method) often has a significant impact 
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on the correctness and effectiveness of the whole model. Furthermore, the change of a 
fuzzy value into a crisp one is the replacement of a complex value with a simpler one. 
Such action usually involves some approximation or rounding, therefore it introduces 
an additional error into the results, as it is generally associated with losing some part 
of the information. The repetition of such operations is not recommended, due to the 
cumulation of the amount of lost information. It is especially inappropriate to use 
the output value of one stage as the input value for another. 

If we want to use fuzzy values for modeling more complex structures such as the 
brain, the exclusion of the fuzzification and defuzzification operations outside the 
base system is recommended. Therefore as the basic tool for processing complex 
functionality expressed linguistically we propose to define a fuzzy system without 
fuzzification and defuzzification stages as the fuzzy inference block (FIB). The idea 
is presented in Fig. 18.1. 

Such an element is a conceptual base for cascade modeling of complex relations 
described linguistically. The potential of such an idea in modeling complex relations 
is presented in Fig. 18.2. 

It is worth noting that every FIB can represent one agent from the multiagent 
architecture. With this approach, we can describe even more complex structures. It 
is easy to imagine that, in place of individual FIBs, we can insert another complex 
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system so it seems to be a kind of recursion, where only the lowest level relates 
directly to the FIBs. Still, despite the high complexity of the model, relations are 
described linguistically at various stages. 

However, although the idea of FIBs seems to be quite suitable for the linguistic 
modeling of complex relations, some problems may arise. The classical methods 
for fuzzy models often produce fuzzy answer sets, which are quite fragmented, not 
normal, and not convex. Such results are formally still fuzzy sets, but their forward 
processing without defuzzification could be questionable. 

Such problems do not occur if we use the OFN model. Its important advantage 
here is that we get a kind of fuzzy number at each stage of data processing. Thus the 
further use of such a result is easy and smooth without the need for defuzzification 
and then fuzzification again. 


18.6.2 Improving Policy Gradient Method 


Apart from modeling complex functionality described linguistically, the OFN can be 
used in other areas connected with brain modeling. A neural networks idea comes 
from knowledge about basic brain structure: see articles of the neurophysiologist 
Warren McCulloch and a mathematician Walter Pitts (1943) [34], “The Organiza- 
tion of Behavior” of Donald Hebb (1949) [21], and articles of Bernard Widrow and 
Marcian Hoff on ADALINE and MADALINE in the early 1960s [61]. The afore- 
mentioned ideas periodically failed or became more popular, but in the twenty-first 
century, called the century of neuroscience, a reasonable use of the old ideas may 
cause another breakthrough with deeper understanding of the central nervous system 
function. Issues of the average reward optimization, especially in the domain with 
partial observability (e.g. noised), are not easy to replicate within models of predictive 
state representations. Computation of the average reward depends on many parame- 
ters, and varies significantly, especially in a nonstationary environment. Permanent 
states and actions make this task particularly difficult. Obviously, the complexity of 
a well-known task and the associated reduced number of dimensions may increase 
efficiency of the computational system, but we should be aware that the brain cal- 
culates such tasks almost in real-time, taking into consideration many hidden states 
(e.g., environment, past behavior, own preferences, or even emotions). Such compu- 
tational processes may reflect natural error-driven learning and adaptation, thanks to 
built-in short-term neuroplasticity, and their influence on long-term brain plasticity 
(e.g., memories, motivations, feelings, etc.). Thus enhanced discrimination of the 
single neuron, use of synapses as estimators of presynaptic membrane potentials, 
and temporal and spatial processing may be reflected in neuronal computation of 
the brain area function/response. Even connectomics cannot avoid current technical 
limitations. Although fuzziness of this process and nonrandom features of cortical 
connectivity allow some attempts with OFNs, these attempts, although simple, may 
play a significant role within the richness of its high-level cognitive processes as 
well as provide quicker and more predictable calculations. Earlier studies on policy 
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gradient methods within reinforcement learning [18, 59, 62, 65] showed the positive 
role of the optimizing parameterized policies with respect to the expected return by a 
gradient descent, without their many disadvantages. As a result, we can more deeply 
understand reward-related learning problems in animals, humans, or machines. Thus 
we propose our own solution of the element of the long-term cumulative reward, tak- 
ing into consideration its fuzziness. 

One important issue on this subject is also the problem of objective function opti- 
mization. Finding the maximum value of the reward function R is often a guarantee 
to find the best change in a given step. However, the cost of calculating such an 
optimum can be too high to ensure its practical usefulness. This applies especially to 
situations where this reward function changes dynamically during time steps. A bet- 
ter choice may be to improve other parameters such as the learning rate coefficient, 
for example. 

The change of weight between n; and n; is calculated as follows. 


u = aR(te;;(t) (18.1) 


where a is the learning rate, the number from the [0; 1] interval, R is the reward 
function, and e;; is the eligibility trace between n; and n; neurons from two adjacent 
layers (see Fig. 18.3). 

Both the reward function and eligibility trace are complex problems. Expanding 
them with further calculations requires a lot of caution, because it is easy to overload 
the process with time-consuming computations. Therefore to improve a solution of 
the problem with determining weights of neurons the learning rate coefficient seems 
the right choice, for a start. It is worth noting that the learning rate at the 0 level is in 
fact no change of weight, thus no adaptation will proceed in such a step. Therefore 
the interval (0; 1] could be used instead. However, the zero level can represent the 
perfect optimum where the adaptation of this weight definitely ends, thus formally 
we keep zero as the low-bound in the interval of values for the learning rate. 
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Fig. 18.4 Input and output values for the classic fuzzy system 


18.6.3 Modeling Learning Rate with the OFNs 


The learning rate is a real number from the [0; 1] interval. The less value there is, 
the smaller are the changes applied to the weight (see formula 18.1). Many scientists 
focus their work on the adaptation and other changes of this coefficient [15, 31, 
53]. In general, when an idea of switching the learning rate is used in the neural 
network it is recommended that values of this parameter should be greater at the 
start of the process adaptation, when weight changes also are higher. In the course 
of the adaptation development the changes of weights are smaller, and the learning 
rate also should decrease. The above assumptions enable formulation of linguistic 
rules in a classic fuzzy system context as follows. 


e IF ‘previous change’ is ‘low’ THEN ‘learning rate’ is ‘low’ 
e IF ‘previous change’ is ‘high’ THEN ‘learning rate’ is ‘high’ 


If we define ‘low’ and ‘high’ as fuzzy numbers (see Fig. 18.4), we can generate the 
learning rate value directly from such rules. The general conception of the proposed 
fuzzy system is to appoint the learning rate on the basis of previous change of the 
weight expressed as a percentage. 

As an alternative, a simple fuzzy system based on the OFN model and its special 
methods and properties is proposed. 

With the use of the OFN model context, we can formulate just one rule that 
expresses a trend of changes in the learning rate parameter. 


e IF ‘previous change’ is ‘about 50% and decreasing’ THEN ‘learning rate’ is ‘about 
0.5 and decreasing’ 


Figure 18.5 presents the OFN for the rule above. 

If we use ‘the directed inference by multiplication with a shift’ presented in Sect. 
5.4.1 of Chap. 5 a single rule will be sufficient to express the expected dependency. 
Figure 18.6 shows the examples that present the general idea of the proposed process- 
ing. One can see that the activation in the down-part area of input, ‘the previous 
change’ will shift the result in the direction of the down- part of the OFN from the 
conclusion. An analogous situation will be with the up-part. Thus it is possible to 
reach the whole space of output values. 
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Fig. 18.5 OFN for fuzzy system 
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Fig. 18.6 OFN for fuzzy system 


18.7 Discussion 


The system proposed in the previous section is very simple, and generally gives 
exactly the same results as simple mapping from the [0; 100] interval into [0; 1]. But 
this proposition shows the potential of applying OFNs in linguistic modeling of the 
learning rate. We may intuitively change the algorithm by changing the linguistic 
expression. If we want to obtain a smaller learning rate in the case where the previous 
change of weight is below 30% we may formulate the rule linguistically: 


e IF ‘previous change’ is ‘about 30% and decreasing’ THEN ‘learning rate’ is ‘about 
0.5 and decreasing’. 


Figure 18.7 presents the example for such a rule. The input value is the same as in 
the previous case (see Fig. 18.6), therefore we can compare the results. Now it is 
not a simple proportional mapping between intervals [0; 100] and [0; 1]. It considers 
the preferences expressed linguistically. One can observe in Fig. 18.7 that a trend 
is preserved, because the input is still on the down-part side of the OFN for the 
premise part of the rule, thus the result is on the down-part side of the OFN from the 
conclusion. 

Using the same intuitive way, we can easily modify the conclusion of the rule. 
If we want, for example, to keep the value of the learning rate above 0.7 until the 
previous change of weight is not lower than 30%, we can express it by the rule as 
follows. 
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Fig. 18.7 OFNs for fuzzy system 


e IF ‘previous change’ is ‘about 30% and decreasing’ THEN ‘learning rate’ is ‘about 
0.7 and decreasing’. 


The above examples show the intuitive and flexible usefulness of modeling the learn- 
ing rate using OFNs. Nevertheless it is also worth noting that we have OFNs at output. 
We can, of course, defuzzify the result, but the learning rate is only part of a com- 
plex algorithm of calculating the weight change of connections between neurons as 
presented in the formula 18.1. If we use the OFN for modeling other elements such 
as ‘reward function’ or ‘eligibility trace’ there will be another fuzzy number in the 
algorithms. Because defuzzification generally causes loss of part of the information, 
we should therefore do it at the end of all calculations instead of only after determin- 
ing the learning rate coefficient. It enables us to process full imprecise information 
contained in the data until the moment when we really need a precise result. 


18.7.1 Results of Other Scientists 


Current approaches to central nervous system modeling aim at bringing experimen- 
tal, computational, and theoretical results closer. Scientific questions should help 
to decide which approach can be regarded as minimal. Experimental outcomes and 
nonlinear interactions cannot be ignored even within the minimal computational 
models, because they may cause misleading conclusions or even confirm erroneous 
theories. Thus ad hoc simplification must be very careful. There are still many gaps 
in neuroscience (e.g., fragmented data sets), as regards both knowledge and experi- 
ence; thus there are discussions concerning limitation of amounts of free parameters 
within models (which may cause so-called island models) without the possibility of 
comparison with the others and tuning using experimental datasets. The most impor- 
tant challenge is integration of the current data into a unified model of the brain as 
a single multilevel model. We need to explore, verify, and apply experiences from 
many various areas of science: from modeling of severe illnesses [17] and traditional 
neuronal networks [50, 51], through liquid state machines [63, 64] to liquid and gas 
distribution in porous materials [7—9]. 


318 P. Prokopowicz and D. Mikotajewski 


18.7.2 Limitations of Our Approach and Directions 
for Further Research 


The main limitation is a high amount of knowledge and experience as well as a need 
for an interdisciplinary research team to prepare valid and relevant models. Such 
teams, incorporating clinicians, are rare. 

Consensus concerning model classification, performance, and interpretation is 
needed to provide consistent methodology to ensure diagnostic and prognostic con- 
sistency. A coherent theoretical framework for explaining SC and FC patterns and 
their alterations in brain diseases is required. The high computational power of the 
brain coupled with low consumption of energy may serve as a basis for the next 
generation of computational devices. Neuromorphic computing systems may allow 
us to reflect the stochastic behavior of simple, reliable, very fast, low-power comput- 
ing devices embedded in intensely recursive architectures, based on brain-derived 
patterns [6]. 


18.8 Conclusions 


Our results confirm that our new OFN fuzzy-based approach towards brain func- 
tion modeling may be efficient and helpful in some time-consuming computational 
problems. Such a fuzzy-based approach may in selected cases also be more similar 
to natural neural signal processing than classical digital models. The idea of a fuzzy 
inference block opens a new direction towards the use of good processing properties 
of an OFN model in describing complex functions while preserving the intuitiveness 
of linguistic description. It seems to be of particular importance for the area where 
two scientific disciplines meet, that is, medical research dealing with diseases and 
injuries of the brain and computer science research. 
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